-- Logs begin at Mon 2022-10-03 11:56:17 UTC, end at Mon 2022-10-03 13:09:58 UTC. -- Oct 03 12:40:27.466825 dv-cinder-844563-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 03 12:40:27.476598 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 03 12:40:27.478559 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 3 12:40:27 2022] *** Oct 03 12:40:27.478559 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 03 12:40:27.478559 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 03 12:40:27.478559 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: nodename: dv-cinder-844563-12-iscsi Oct 03 12:40:27.478559 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: machine: x86_64 Oct 03 12:40:27.478559 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: clock source: unix Oct 03 12:40:27.478559 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: pcre jit disabled Oct 03 12:40:27.478559 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: detected number of CPU cores: 4 Oct 03 12:40:27.478559 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: current working directory: / Oct 03 12:40:27.478559 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: detected binary path: /usr/bin/uwsgi-core Oct 03 12:40:27.479259 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: your processes number limit is 47680 Oct 03 12:40:27.479259 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: your memory page size is 4096 bytes Oct 03 12:40:27.479259 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: detected max file descriptor number: 2048 Oct 03 12:40:27.479259 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: lock engine: pthread robust mutexes Oct 03 12:40:27.479259 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: thunder lock: enabled Oct 03 12:40:27.479259 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 03 12:40:27.479259 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 03 12:40:27.518307 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: Python main interpreter initialized at 0x55f305bf69c0 Oct 03 12:40:27.518307 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: python threads support enabled Oct 03 12:40:27.518307 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: your server socket listen backlog is limited to 100 connections Oct 03 12:40:27.518307 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: your mercy for graceful operations on workers is 90 seconds Oct 03 12:40:27.518676 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: mapped 403077 bytes (393 KB) for 2 cores Oct 03 12:40:27.518676 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: *** Operational MODE: preforking *** Oct 03 12:40:27.518922 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: *** uWSGI is running in multiple interpreter mode *** Oct 03 12:40:27.518922 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: spawned uWSGI master process (pid: 112499) Oct 03 12:40:27.519114 dv-cinder-844563-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 03 12:40:27.520635 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: spawned uWSGI worker 1 (pid: 112500, cores: 1) Oct 03 12:40:27.520635 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: spawned uWSGI worker 2 (pid: 112501, cores: 1) Oct 03 12:40:27.520635 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 03 12:40:28.187775 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 12:40:28.190151 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 12:40:29.275857 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 12:40:29.275857 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: from cryptography.utils import int_from_bytes Oct 03 12:40:29.276432 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 12:40:29.276432 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: from cryptography.utils import int_from_bytes Oct 03 12:40:29.284280 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 12:40:29.284280 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: from cryptography.utils import int_from_bytes Oct 03 12:40:29.284716 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 12:40:29.284716 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: from cryptography.utils import int_from_bytes Oct 03 12:40:31.806631 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 12:40:31.807178 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 12:40:31.807436 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 12:40:31.807555 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 12:40:31.807912 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 12:40:31.807997 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 12:40:31.808094 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 12:40:31.808246 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 12:40:31.808411 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.808610 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 12:40:31.808743 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.808866 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 12:40:31.809063 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.809256 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.809382 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.809583 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.809719 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.809906 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.810011 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.810226 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.810324 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.810565 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.810671 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.810877 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.810971 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.811191 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.811282 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.811536 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.811654 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.811858 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-12-iscsi {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.811948 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.812117 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.812203 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.812435 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.812532 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.812759 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-12-iscsi {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.812856 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.813077 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.813165 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.813381 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.813480 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.813689 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.813778 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.814058 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.814235 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.814366 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.814689 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.814776 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.814996 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.815159 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.815492 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.815574 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.815808 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.815887 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.816176 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.816315 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.816420 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.816510 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.816740 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.816871 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.817051 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.817152 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.817356 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.817443 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.817672 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.817758 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.817978 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.818078 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.818299 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.818393 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-12-iscsi {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.818609 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.818710 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.818971 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.819057 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-12-iscsi {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.819283 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.819448 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.819635 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.819766 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.819949 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.820063 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.820321 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.820415 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.820641 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.820773 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.820964 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.821065 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.821269 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.821356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.821596 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.821728 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.821902 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.821990 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.822216 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.822309 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.822533 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.822621 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.822833 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.822923 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.823139 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.823235 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.823469 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.823559 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.823781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.823910 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.824078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.824165 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.824382 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.824471 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.824632 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.824727 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.824937 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.825026 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.825217 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.825312 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.825524 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.825619 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.825862 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.825965 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.826107 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.826265 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.826357 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.826475 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.826661 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.826759 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.826966 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.827055 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.827278 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.827403 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.827608 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.827707 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.827915 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.828003 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.828221 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.828318 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.828526 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.828626 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.828831 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.828918 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.829133 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.829220 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.829950 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.830088 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.830288 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.830384 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.830597 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.830685 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.830916 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.831015 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.831223 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.831338 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.831568 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.831658 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.831880 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.831976 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.832199 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.832287 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.832507 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.832594 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.832833 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.832927 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.833143 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.833232 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.833448 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.833534 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.833770 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.833864 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.834085 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.834182 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.834387 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.834474 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.834691 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.834783 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.834996 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.835084 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.835300 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.835444 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.835629 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.835719 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.835946 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.836033 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.836195 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.836297 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.836495 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.836594 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.836796 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.836892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.837199 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.837313 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.837398 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.837483 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.837695 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.837794 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.837999 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.838097 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.838298 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.838399 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.838601 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.838695 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.838900 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.839001 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.839202 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.839297 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.839530 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.839618 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.839834 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.839931 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.840136 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.840222 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.840436 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.840523 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.840739 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.840835 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.841039 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.841125 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.841340 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.841428 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.841641 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.841729 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.841946 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.842036 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.842247 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.842341 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.842548 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.842644 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.842851 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.842940 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.843151 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.843246 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.843491 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.843593 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.843799 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.843886 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.844101 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.844189 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.844409 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.844502 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.844708 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.844796 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.845008 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.845703 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.845872 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.845962 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.846183 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.846279 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.846497 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.846583 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.846800 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.846888 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.847102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.847189 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.847442 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.847547 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.847999 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.848094 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.848307 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.848396 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.848625 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.848722 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.848927 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.849014 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.849229 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.849324 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.849531 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.849627 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.849830 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.849923 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.850131 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.850267 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.850430 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.850526 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.850727 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.850823 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.851027 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.851113 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.851336 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.851508 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.851659 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.851754 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.851960 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.852087 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.852261 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.852353 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.852566 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.852653 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.852871 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.852959 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.853189 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:40:31.853278 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.853523 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.853610 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.853840 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.853927 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.854168 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.854257 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.854484 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.854584 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.854801 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.854897 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.855110 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.855197 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.855448 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.855540 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.855764 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.855869 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.856071 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.856157 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.856380 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.856480 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.856691 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.856796 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.857000 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.857087 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.857312 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.857421 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.857627 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.857724 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.857939 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.858025 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.858252 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.858340 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.858569 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.858666 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.858878 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.858967 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.859192 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.859286 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.859530 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.859636 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.859850 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.859947 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.860160 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.860255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.860492 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.860582 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.860832 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.861059 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.861160 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.861243 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.861503 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.861594 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.861820 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.861908 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.862130 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.862223 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.862442 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.862531 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.862754 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.862841 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.863064 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.863151 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.863398 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.863491 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.863729 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.863816 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.864043 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.864143 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.864352 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.864440 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.864670 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.864764 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.864980 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.865084 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.865291 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.865381 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.865603 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.865690 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.865913 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.866013 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.866223 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.866310 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.866537 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.866624 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.866849 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.866950 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.867167 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.867256 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.867507 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.867597 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.867821 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.867927 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.868134 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.868222 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.868442 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.868528 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.868751 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.868840 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.869059 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.869147 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.869364 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.869459 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.869666 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.869761 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.869969 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.870057 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.870273 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.870361 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.870573 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.870664 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.870881 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.870968 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.871186 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.871274 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.871519 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.871609 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.871850 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.871938 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.872155 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.872296 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.872464 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.872554 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.872774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.872862 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.873082 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.873178 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.873383 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.873477 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.873691 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.873784 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.873998 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.874162 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.874301 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.874430 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.874609 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.874697 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.874914 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.875015 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.875215 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.875302 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.875556 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.875645 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.875860 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.875949 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.876165 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.876252 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.876507 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.876619 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.876819 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.876911 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.877140 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.877245 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.877452 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.877541 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.877765 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.877854 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.878079 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.878166 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.878392 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.878480 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.878704 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.878792 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.879020 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.879108 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.879349 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.879455 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.879671 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.879759 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.879995 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.880084 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.880306 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.880403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.880623 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.880710 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.880927 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.881022 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.881237 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.881334 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.881540 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.881627 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.881842 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.881936 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.882144 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.882247 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.882450 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.882542 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.882749 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.882836 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.883054 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.883142 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.883379 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.883479 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.883685 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.883772 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.883990 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.884078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.884296 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.884383 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.884602 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.884693 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.884903 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.884993 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.885206 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.885293 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.885509 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.885607 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.885812 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.885900 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.886116 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.886206 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.886457 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.886554 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.886762 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.886849 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.887089 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.887182 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.887435 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.887540 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.887750 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.887838 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.888063 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.888150 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.888371 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.888506 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.888680 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.888768 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.888990 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.889078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.889295 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.889391 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.889604 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.889691 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.889912 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.889998 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.890230 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.890326 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.890535 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.890621 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.890852 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.890937 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.891160 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.891254 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.891500 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.891588 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.891804 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.891892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.892664 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.892775 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.892976 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.893064 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.893351 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.893465 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.893668 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.893810 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.893988 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.894146 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.894303 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.894465 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.894603 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.894790 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.894911 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.895104 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.895220 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.895444 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.895548 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.895759 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.895847 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.896070 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.896165 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.896382 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.896478 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.896694 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.896783 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.897015 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.897103 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.897327 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.897416 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.897645 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.897732 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.897953 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.898039 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.898253 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.898341 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.898568 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.898655 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.898882 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.898981 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.899189 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.899278 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.899530 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.899619 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.899843 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.899948 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.900164 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.900252 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.900471 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.900565 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.900778 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.900878 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.901088 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.901177 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.901393 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.901488 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.901695 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.901800 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.902002 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.902099 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.902306 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.902400 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.902611 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.902754 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.902917 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.903014 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.903220 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.903375 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.903541 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.903632 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.903851 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.903938 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.904152 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.904247 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.904458 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.904546 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.904764 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.904851 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.905069 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.905157 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.905373 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.905462 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.905687 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.905776 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.906003 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.906098 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.906306 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.906396 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.906609 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.906705 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.906929 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.907031 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.907231 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.907339 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.907584 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.907710 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.908026 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.908154 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.908335 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.908470 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.908678 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.908765 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.908988 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.909084 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.909293 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.909388 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.909623 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.909751 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.909929 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.910027 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.910238 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.910326 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.910552 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.910640 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.910862 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.910958 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.911171 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.911258 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.911524 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.911625 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.911838 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.911928 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.912152 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.912249 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.912476 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.912564 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.912783 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.912879 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.913093 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.913182 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.913402 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.913489 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.913711 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.913800 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.914017 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.914103 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.914323 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.914419 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.914635 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.914722 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.914939 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.915033 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.915247 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.915366 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.915586 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.915675 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.915891 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.916151 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.916239 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.916478 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.916567 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.916791 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.917063 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.917249 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.917397 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.917504 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.917714 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.917816 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.918035 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.918177 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.918359 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.918455 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.918670 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.918776 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.918973 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.919063 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.919281 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.919414 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.919610 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.919712 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.919915 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.920012 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.920224 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.920312 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.920526 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.920632 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.920830 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.920916 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.921130 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.921216 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.921439 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.921529 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.921740 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.921835 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.922043 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.922130 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.922345 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.922433 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.922646 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.922734 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.922952 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.923039 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.923808 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.923954 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.924110 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.924228 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.924414 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.924503 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.924719 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.924809 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.925032 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.925120 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.925331 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.925427 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.925633 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.925721 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.925934 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.926022 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.926240 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.926336 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.926544 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.926632 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.926848 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.926935 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.927189 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.927284 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.927520 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.927618 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.927841 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.927929 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.928144 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.928314 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.928463 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.928564 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.928765 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.928854 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.929067 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.929163 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.929369 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.929458 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.929675 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.929763 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.929976 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.930065 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.930274 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.930361 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.930581 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.930675 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.930885 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.930975 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.931192 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.931283 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.931519 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.931608 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.931820 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.931910 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.932126 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.932215 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.932428 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.932534 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.932728 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.932824 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.933035 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.933122 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.933336 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.933432 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.933634 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.933722 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.933941 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.934036 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.934244 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.934340 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.934541 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.934635 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.934849 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.934936 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.935149 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.935244 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.935474 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.935563 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.935775 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.935864 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.936075 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.936172 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.936374 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.936462 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.936680 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.936767 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.936984 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.937073 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.937282 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.937369 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.937589 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.937675 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.937896 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.937993 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.938196 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.938338 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.938498 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.938588 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.938828 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.938973 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.939179 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.939379 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.939680 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.939783 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.939997 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.940086 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.940305 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.940394 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.940612 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.940709 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.940914 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.941002 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.941223 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.941312 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.941528 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.941626 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.941831 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.941920 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.942132 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.942227 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.942436 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.942542 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.942733 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.942827 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.943034 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.943121 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.943349 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.943440 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.943656 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.943756 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.943957 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.944046 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.944262 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.944351 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.944566 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.944655 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.944865 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.944953 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.945174 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.945263 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.945474 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.945563 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.945777 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.945864 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.946082 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.946179 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.946386 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.946482 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.946731 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.946826 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.947035 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.947123 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.947375 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.947476 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.947690 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.947788 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.947998 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.948094 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.948311 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.948399 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.948612 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.948710 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.948921 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.949016 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.949226 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.949313 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.949531 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.949629 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.949827 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.949914 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.950126 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.950214 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.950443 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.950564 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.950747 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.950850 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.951049 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.951144 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.951392 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.951525 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.951708 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.951795 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.952019 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.952106 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.952318 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.952407 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.952625 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.952712 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.952933 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.953021 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.953238 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.953327 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.953545 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.953632 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.953851 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.953937 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.954157 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.954245 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.954982 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.955100 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.955293 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.955522 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.955614 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.955849 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.955937 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.956163 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.956310 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.956472 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.956562 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.956783 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.956878 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.957091 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.957180 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.957396 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.957486 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.957704 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.957791 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.958010 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.958096 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.958312 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.958401 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.958618 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.958706 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.958920 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.959016 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.959226 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.959346 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.959552 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.959640 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.959863 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.959963 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.960170 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.960259 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.960564 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.960652 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.960865 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.960962 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.961174 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.961263 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.961481 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.961569 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.961791 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.961887 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.962100 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.962198 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.962401 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.962495 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.962718 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.962805 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.963026 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.963121 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.963439 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.963531 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.963753 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.963842 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.964057 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.964154 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.964360 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.964456 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.964663 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.964752 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.964968 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.965057 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.965274 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.965360 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.965581 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.965670 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.965885 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.965981 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.966189 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.966285 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.966495 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.966583 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.966816 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.966903 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.967124 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.967221 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.967472 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.967575 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.967850 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.967943 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.968190 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.968291 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.968497 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.968585 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.968862 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.968949 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.969185 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.969295 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.969504 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.969607 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.969824 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.969911 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.970195 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.970285 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.970525 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.970776 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.970863 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.970943 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.971138 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.971235 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.971473 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.971565 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.971806 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.971897 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.972131 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.972228 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.972443 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.972533 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.973011 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.973114 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.973319 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.973409 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.973631 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.973728 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.973954 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.974043 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.974266 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.974355 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.974589 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.974692 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.974969 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.975058 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.975290 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.975453 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.975639 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.975728 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.975946 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.976034 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.976252 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.976351 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.976564 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.976661 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.976868 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.976957 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.977171 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.977271 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.977476 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.977563 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.977783 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.977873 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.978094 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.978190 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.978402 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.978489 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.978707 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.978804 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.979013 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.979102 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.979333 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.979436 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.979646 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.979734 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.979948 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.980037 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.980268 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.980357 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.980574 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.980662 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.980891 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.980979 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.981206 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.981301 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.981506 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.981632 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.981828 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.981919 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.982137 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.982226 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.982440 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.982540 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.982742 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.982839 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.983046 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.983140 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.983370 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.983481 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.983679 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.983768 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.984016 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.984103 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.984323 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.984424 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.984647 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.984735 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.984956 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.985051 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.985289 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.985379 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.985601 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.986211 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.986518 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.986607 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.986832 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.987010 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.987151 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.987365 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.987505 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.987681 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.987811 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.988005 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.988115 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.988336 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.988424 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.988645 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.988748 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.988953 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.989042 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.989266 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.989362 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.989576 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.989668 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.989883 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.989972 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.990185 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.990272 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.990487 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.990585 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.990792 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.990879 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.991098 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.991185 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.991425 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.991518 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.991747 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.991834 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.992054 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.992155 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.992359 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.992456 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.992663 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.992753 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.992970 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.993066 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.993282 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.993367 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.993572 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.993662 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.993913 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.994010 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.994221 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.994315 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.994541 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.994629 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.994852 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.994950 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.995166 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.995266 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.995505 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.995644 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.995821 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.995921 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.996139 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.996227 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.996452 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.996540 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.996760 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.996850 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.997076 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.997165 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.997392 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.997480 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.997706 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.997797 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.998026 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.998223 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.998344 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.998550 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.998656 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.998866 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.999179 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.999269 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.999517 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.999606 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.999833 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:31.999923 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.000148 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.000237 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.000462 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.000558 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.000773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.000861 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.001087 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.001183 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.001479 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.001595 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.001807 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.001894 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.002131 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.002228 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.002457 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.002565 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.002793 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.002882 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.003110 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.003199 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.003453 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.003548 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.003769 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.003858 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.004083 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.004172 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.004408 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.004498 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.004730 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.004818 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.005034 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.005196 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.005349 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.005438 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.005662 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.005750 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.005975 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.006073 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.006294 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.006382 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.006606 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.006702 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.006918 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.007021 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.007229 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.007343 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.007562 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.007651 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.007872 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.007962 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.008186 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.008281 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.008496 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.008584 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.008808 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.008896 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.009126 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.009214 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.009441 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.009537 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.009752 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.009841 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.010065 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.010154 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.010382 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.010521 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.010697 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.010901 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.011005 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.011218 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.011370 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.011573 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.011856 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.011953 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.012174 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.012263 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.012505 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.012666 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.012822 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.012912 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.013144 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.013232 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.013446 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.013535 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.013752 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.013841 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.014061 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.014150 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.014367 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.014457 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.014672 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.014760 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.014984 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.015079 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.015291 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.015444 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.015615 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.015703 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.015932 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.016024 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.016240 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.016329 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.016547 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.016772 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.016873 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.017828 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.017928 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.018164 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.018533 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.018753 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.018846 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.019169 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.019285 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.019507 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.019809 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.019911 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.020130 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.020239 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.020438 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.020563 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.020755 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.020889 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.021069 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.021205 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.021374 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.021536 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.021680 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.021848 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.021992 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.022160 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.022301 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.022486 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.022605 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.022802 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.022900 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.023111 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.023201 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.023443 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.023536 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.023764 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.023862 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.024078 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.024173 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.024386 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.024474 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.024700 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.024797 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.025008 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.025097 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.025311 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.025407 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.025616 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.025705 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.025922 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.026010 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.026228 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.026315 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.026530 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.026617 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.026835 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.026922 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.027138 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.027224 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.027467 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.027568 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.027775 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.027863 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.028087 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.028176 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.028393 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.028482 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.028702 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.028790 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.029005 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.029101 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.029310 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.029399 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.029627 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.029716 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.029938 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.030035 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.030251 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.030338 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.030562 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.030650 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.030871 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.030971 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.031175 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.031265 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.031518 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.031608 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.031830 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.032065 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.032161 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.032402 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.032491 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.032818 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.032927 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.033153 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.033243 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.033483 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.033579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.033790 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.034025 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.034114 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.034363 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.034458 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.034688 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.034820 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.034999 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.035087 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.035330 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.035423 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.035643 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.035732 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.035954 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.036044 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.036260 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.036347 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.036568 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.036759 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.036881 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.037083 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.037192 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.037404 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.037502 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.037722 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.037812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.038038 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.038127 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.038352 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.038439 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.038665 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.038754 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.038970 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.039059 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.039281 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.039400 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.039619 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.039709 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.039932 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.040021 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.040244 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.040341 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.040555 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.040653 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.040866 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.040955 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.041173 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.041275 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.041483 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.041572 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.041792 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.041888 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.042100 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.042226 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.042414 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.042502 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.042740 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.042829 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.043056 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.043147 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.043384 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.043477 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.043698 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.044009 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.044108 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.044319 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.044415 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.044635 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.044724 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.044964 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.045063 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.045279 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.045376 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.045587 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.045676 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.045906 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.046217 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.046305 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.046536 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.046626 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.046851 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.046949 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.047180 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.047269 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.047539 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.047631 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.047866 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.047961 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.048713 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.048820 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.049118 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.049205 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.049427 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.049517 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.049733 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.049829 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.050043 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.050132 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.050363 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.050460 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.050674 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.050762 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.050977 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.051094 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.051278 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.051413 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.051612 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.051725 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.051916 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.052036 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.052219 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.052347 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.052522 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.052659 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.052824 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.052977 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.053130 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.053284 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.053429 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.053589 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.053728 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.053900 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.054029 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.054205 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.054329 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.054512 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.054630 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.054817 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.054931 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.055122 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.055238 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.055456 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.055562 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.055762 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.055852 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.056065 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.056154 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.056369 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.056471 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.056722 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.056818 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.056979 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.057069 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.057282 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.057379 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.057594 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.057682 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.057899 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.057987 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.058204 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.058293 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.058506 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.058594 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.058811 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.058954 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.059115 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.059250 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.059473 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.059565 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.059787 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.059875 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.060099 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.060189 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.060420 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.060508 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.060733 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.060821 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.061046 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.061137 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.061355 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.061444 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.061663 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.061760 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.061974 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.062063 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.062282 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.062378 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.062593 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.062690 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.062922 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.063023 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.063230 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.063346 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.063568 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.063667 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.064462 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.064562 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.064778 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.064866 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.065093 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.065192 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.065404 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.065532 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.065732 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.065880 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.066059 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.066370 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.066841 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.067451 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.067544 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.067798 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.067925 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.068120 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.068437 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.068757 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.069078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.069396 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.069744 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.070065 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.070422 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.070756 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.071228 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.071391 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.071566 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.071759 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.071896 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.072122 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.072211 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.072462 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.072561 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.072796 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.072885 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.073125 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.073214 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.073451 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.073542 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.073814 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.074126 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.074433 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.074678 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 12:40:32.075918 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.076261 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.076594 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.076924 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.077256 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.077586 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.077935 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.078273 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.078595 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.078933 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.079271 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.079793 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.080208 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.080607 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.080950 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.081278 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.081600 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.081918 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:40:32.082172 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 12:40:32.249198 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO dbcounter [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] Registered counter for database nova_api Oct 03 12:40:32.262940 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO dbcounter [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] Registered counter for database nova_api Oct 03 12:40:32.272617 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_db.sqlalchemy.engines [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:40:32.285307 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG oslo_db.sqlalchemy.engines [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:40:32.285512 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG dbcounter [-] [112500] Writer thread running {{(pid=112500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:40:32.294688 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG dbcounter [-] [112501] Writer thread running {{(pid=112501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:40:32.358655 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.context [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57c6aefa-012f-4d1a-b081-6750fab41575(cell1) {{(pid=112500) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 12:40:32.363228 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:40:32.363738 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:40:32.364827 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.context [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57c6aefa-012f-4d1a-b081-6750fab41575(cell1) {{(pid=112501) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 12:40:32.365316 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:40:32.366057 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:40:32.366508 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:40:32.368543 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:40:32.370571 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO dbcounter [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] Registered counter for database nova_cell0 Oct 03 12:40:32.371043 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG oslo_concurrency.lockutils [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:40:32.371557 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG oslo_concurrency.lockutils [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:40:32.374517 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG oslo_concurrency.lockutils [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:40:32.374517 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG oslo_concurrency.lockutils [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:40:32.374517 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG oslo_concurrency.lockutils [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:40:32.374787 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO dbcounter [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] Registered counter for database nova_cell1 Oct 03 12:40:32.377554 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG oslo_concurrency.lockutils [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:40:32.378362 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO dbcounter [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] Registered counter for database nova_cell0 Oct 03 12:40:32.383123 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_db.sqlalchemy.engines [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:40:32.383335 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO dbcounter [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] Registered counter for database nova_cell1 Oct 03 12:40:32.384293 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_db.sqlalchemy.engines [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:40:32.390702 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG dbcounter [-] [112500] Writer thread running {{(pid=112500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:40:32.390878 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG oslo_db.sqlalchemy.engines [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:40:32.396151 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG oslo_db.sqlalchemy.engines [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:40:32.400422 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG dbcounter [-] [112501] Writer thread running {{(pid=112501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:40:32.406109 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG dbcounter [-] [112501] Writer thread running {{(pid=112501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:40:32.548781 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG dbcounter [-] [112500] Writer thread running {{(pid=112500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:40:32.560721 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO dbcounter [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] Registered counter for database nova_cell0 Oct 03 12:40:32.570194 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_db.sqlalchemy.engines [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:40:32.576417 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO dbcounter [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] Registered counter for database nova_cell0 Oct 03 12:40:32.576891 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG dbcounter [-] [112500] Writer thread running {{(pid=112500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:40:32.586205 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG oslo_db.sqlalchemy.engines [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:40:32.598465 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG dbcounter [-] [112501] Writer thread running {{(pid=112501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:40:33.014922 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: WARNING keystonemiddleware.auth_token [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 12:40:33.022538 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: WARNING keystonemiddleware.auth_token [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 12:40:33.049820 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: WARNING keystonemiddleware.auth_token [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 12:40:33.057545 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: WARNING keystonemiddleware.auth_token [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 12:40:33.367564 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: WARNING keystonemiddleware.auth_token [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 12:40:33.373426 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: WARNING keystonemiddleware.auth_token [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 12:40:33.378722 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f305bf69c0 pid: 112500 (default app) Oct 03 12:40:33.380801 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:40:33.381978 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001716 Oct 03 12:40:33.382392 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Mon Oct 3 12:40:33 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:40:33.399747 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: WARNING keystonemiddleware.auth_token [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 12:40:33.405651 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: WARNING keystonemiddleware.auth_token [None req-9fe93646-efaf-4018-8231-050a99015ee7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 12:40:33.411572 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f305bf69c0 pid: 112501 (default app) Oct 03 12:41:58.097462 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:41:58.098410 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 03 12:41:58.099066 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 12:41:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:41:58.112779 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG dbcounter [-] [112501] Writing DB stats nova_api:SELECT=3 {{(pid=112501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:58.113731 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG dbcounter [-] [112501] Writing DB stats nova_cell1:SELECT=3 {{(pid=112501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:58.114928 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG dbcounter [-] [112501] Writing DB stats nova_cell0:SELECT=3 {{(pid=112501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:58.116919 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG dbcounter [-] [112501] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:59.117609 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-1c1f5761-b4c7-458d-9e3a-acb04a9057d7 admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:41:59.150243 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-1c1f5761-b4c7-458d-9e3a-acb04a9057d7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.043858 Oct 03 12:41:59.151554 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1292 bytes} [Mon Oct 3 12:41:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:42:01.851825 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:01.852839 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-a4965195-3d16-498e-b777-da8b4e800815 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 03 12:42:01.853567 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 12:42:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:42:02.294198 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-572b98c0-2ca4-47ef-964b-b43197938ec8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1"}} {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:02.441425 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-572b98c0-2ca4-47ef-964b-b43197938ec8 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.581833 Oct 03 12:42:02.441996 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 12:42:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 12:42:02.457234 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG dbcounter [-] [112500] Writing DB stats nova_api:SELECT=3 {{(pid=112500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:02.458055 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG dbcounter [-] [112500] Writing DB stats nova_cell1:SELECT=3 {{(pid=112500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:02.460012 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG dbcounter [-] [112500] Writing DB stats nova_cell0:SELECT=3 {{(pid=112500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:02.460788 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG dbcounter [-] [112500] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:02.671741 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-322cca3a-0458-4b4f-92cd-9ab6ec6660dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:02.820493 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-322cca3a-0458-4b4f-92cd-9ab6ec6660dc admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.369077 Oct 03 12:42:02.821345 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Oct 3 12:42:02 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:42:05.436673 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-572b98c0-2ca4-47ef-964b-b43197938ec8 admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:05.437704 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-572b98c0-2ca4-47ef-964b-b43197938ec8 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 03 12:42:05.438104 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 12:42:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:42:06.113161 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-4bd2423b-1a8a-49e1-9206-c4d265e015b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "disk": 5, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "id": "d1"}} {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:06.246129 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-4bd2423b-1a8a-49e1-9206-c4d265e015b6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.801267 Oct 03 12:42:06.247414 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 12:42:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 12:42:06.259937 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-68110f43-2a08-40fe-b510-f3a148ec71fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:06.384781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-68110f43-2a08-40fe-b510-f3a148ec71fa admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128398 Oct 03 12:42:06.385305 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Oct 3 12:42:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:42:08.961532 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-4bd2423b-1a8a-49e1-9206-c4d265e015b6 admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:08.962464 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-4bd2423b-1a8a-49e1-9206-c4d265e015b6 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 03 12:42:08.962862 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 12:42:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:42:09.388105 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-29820dc7-555b-45bd-b395-a10f3d8a4991 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "ram": 1024, "id": "d2", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:09.499734 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-29820dc7-555b-45bd-b395-a10f3d8a4991 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.530387 Oct 03 12:42:09.500296 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 12:42:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 12:42:09.518039 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-87242ae8-967b-4417-b452-8d1f75f74b74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:09.608084 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-87242ae8-967b-4417-b452-8d1f75f74b74 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098347 Oct 03 12:42:09.608657 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Oct 3 12:42:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:42:12.252121 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-29820dc7-555b-45bd-b395-a10f3d8a4991 admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:12.253502 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-29820dc7-555b-45bd-b395-a10f3d8a4991 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002450 Oct 03 12:42:12.253908 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 12:42:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:42:12.677413 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-adf17530-b4fb-404c-8b1f-aeb287952c55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "rxtx_factor": 1.0, "id": "d3", "vcpus": 2, "os-flavor-access:is_public": true, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:12.794437 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-adf17530-b4fb-404c-8b1f-aeb287952c55 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.534359 Oct 03 12:42:12.795225 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 12:42:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:42:12.807602 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-4b36f73c-34ae-4772-a8c1-cc3a627f90e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:12.881509 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-4b36f73c-34ae-4772-a8c1-cc3a627f90e0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077641 Oct 03 12:42:12.882409 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Oct 3 12:42:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:42:15.682522 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-adf17530-b4fb-404c-8b1f-aeb287952c55 admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:15.683647 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-adf17530-b4fb-404c-8b1f-aeb287952c55 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Oct 03 12:42:15.684262 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 12:42:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:42:16.096905 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-2fc925bf-73c7-4188-9ddb-cc9ec9fa3242 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:16.163540 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-2fc925bf-73c7-4188-9ddb-cc9ec9fa3242 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.471826 Oct 03 12:42:16.164410 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 12:42:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 12:42:16.177862 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-bbc19a8f-764b-472d-ab2b-ab1fc568efbd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:16.243532 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-bbc19a8f-764b-472d-ab2b-ab1fc568efbd admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070098 Oct 03 12:42:16.244526 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Oct 3 12:42:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:42:19.024196 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-2fc925bf-73c7-4188-9ddb-cc9ec9fa3242 admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:19.025154 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-2fc925bf-73c7-4188-9ddb-cc9ec9fa3242 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Oct 03 12:42:19.025577 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 12:42:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:42:19.613445 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-3d1f44e7-677d-4ae4-8e85-e5ae00a0c5f0 admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:19.638465 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-3d1f44e7-677d-4ae4-8e85-e5ae00a0c5f0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.605524 Oct 03 12:42:19.639000 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1292 bytes} [Mon Oct 3 12:42:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:42:22.223692 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-2fc925bf-73c7-4188-9ddb-cc9ec9fa3242 admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:22.225763 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-2fc925bf-73c7-4188-9ddb-cc9ec9fa3242 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002495 Oct 03 12:42:22.226297 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 12:42:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:42:22.657228 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-6059989b-9d03-46ef-ae9f-8863147be2d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "id": "1", "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:22.805612 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-6059989b-9d03-46ef-ae9f-8863147be2d2 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.572632 Oct 03 12:42:22.806362 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 12:42:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:42:22.820256 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-70c429a9-f406-495b-900e-8dffdfacb8a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:22.897449 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-70c429a9-f406-495b-900e-8dffdfacb8a0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080800 Oct 03 12:42:22.898346 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Oct 3 12:42:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:42:25.540308 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-6059989b-9d03-46ef-ae9f-8863147be2d2 admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:25.541318 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-6059989b-9d03-46ef-ae9f-8863147be2d2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 03 12:42:25.541750 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 12:42:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:42:25.952499 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-744a5aa1-469a-4663-ae39-60c5f974daaf admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:26.024563 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-744a5aa1-469a-4663-ae39-60c5f974daaf admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.476379 Oct 03 12:42:26.025151 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 12:42:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:42:26.037012 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-e77cca17-44c8-4c41-bdf7-ab219627997e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:26.114978 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-e77cca17-44c8-4c41-bdf7-ab219627997e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081469 Oct 03 12:42:26.115665 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Oct 3 12:42:26 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:42:28.822139 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-744a5aa1-469a-4663-ae39-60c5f974daaf admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:28.823143 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-744a5aa1-469a-4663-ae39-60c5f974daaf admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 03 12:42:28.823764 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 12:42:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:42:29.218400 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-693eaf75-c7e6-4157-9169-24da44e557c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "rxtx_factor": 1.0, "id": "3", "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:29.831466 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-693eaf75-c7e6-4157-9169-24da44e557c9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.001662 Oct 03 12:42:29.843130 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 12:42:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:42:29.845215 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-cf10d73d-9d3d-4529-868a-c551ed023956 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:29.863040 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG dbcounter [-] [112501] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:30.263548 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-cf10d73d-9d3d-4529-868a-c551ed023956 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.422480 Oct 03 12:42:30.264566 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Oct 3 12:42:29 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:42:33.132967 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-693eaf75-c7e6-4157-9169-24da44e557c9 admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:33.134703 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-693eaf75-c7e6-4157-9169-24da44e557c9 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002172 Oct 03 12:42:33.139950 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 12:42:33 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:42:33.669075 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-c542f779-0c9c-448d-b3bb-69140dccf271 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "disk": 80, "id": "4"}} {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:33.747533 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-c542f779-0c9c-448d-b3bb-69140dccf271 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.605576 Oct 03 12:42:33.748477 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 12:42:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:42:33.768756 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-2310caa4-488f-4e86-adfa-22ba63a18f1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:33.835585 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-2310caa4-488f-4e86-adfa-22ba63a18f1b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075678 Oct 03 12:42:33.836551 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Oct 3 12:42:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:42:36.744914 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-c542f779-0c9c-448d-b3bb-69140dccf271 admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:36.745843 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-c542f779-0c9c-448d-b3bb-69140dccf271 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 03 12:42:36.746249 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 12:42:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:42:37.169464 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-42947c02-5de6-4eb6-8f10-d8844a1de7eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "vcpus": 8, "ram": 16384, "swap": 0, "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:37.179709 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG dbcounter [-] [112500] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:37.219041 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-42947c02-5de6-4eb6-8f10-d8844a1de7eb admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.466466 Oct 03 12:42:37.219897 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 12:42:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:42:37.233028 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-a065393a-8ad3-4aa7-9a36-ece4822c2053 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:42:37.333001 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-a065393a-8ad3-4aa7-9a36-ece4822c2053 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103944 Oct 03 12:42:37.333615 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Oct 3 12:42:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:42:55.973189 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-42947c02-5de6-4eb6-8f10-d8844a1de7eb admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:55.974115 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-42947c02-5de6-4eb6-8f10-d8844a1de7eb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 03 12:42:55.974526 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 12:42:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:42:55.985605 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG dbcounter [-] [112501] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:56.364636 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-95f4a5a6-fdb1-4e2a-aa59-36e2b454bc4d admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:56.384815 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-95f4a5a6-fdb1-4e2a-aa59-36e2b454bc4d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403695 Oct 03 12:42:56.385368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1292 bytes} [Mon Oct 3 12:42:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:42:57.704579 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-42947c02-5de6-4eb6-8f10-d8844a1de7eb admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:57.705578 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-42947c02-5de6-4eb6-8f10-d8844a1de7eb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001989 Oct 03 12:42:57.705964 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 12:42:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:42:58.225827 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-634f45dc-51ea-4d85-b18f-5ab10e9174d5 admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:58.231262 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.wsgi [None req-634f45dc-51ea-4d85-b18f-5ab10e9174d5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-634f45dc-51ea-4d85-b18f-5ab10e9174d5 admin admin] Request method failure captured: Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Accept: application/json Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Accept-Encoding: gzip, deflate Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Connection: keep-alive Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Content-Length: 0 Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Host: 10.222.0.33 Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Openstack-Api-Version: compute 2.92 Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Openstack-System-Scope: None Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: User-Agent: python-novaclient Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Auth-Token: gAAAAABjOtjRN9ubbs-dgOUbNvpvIg3Nm11tqcUNY3HIaab2N-98RsH7Sfpl0PRWzFguB8oz1BT5K3MAy8lgghp-vcoF0FEC8jSqUXg9NsEN9CiuHqrNyNjV56hhjpO3BYOowQl0ieQZ-9-c7iHmEqPO-dZ9BNJuAR1oYbPrqRCIBU8CnFx0oxw Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Domain-Id: None Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Domain-Name: None Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Identity-Status: Confirmed Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Is-Admin-Project: True Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Project-Domain-Id: default Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Project-Domain-Name: Default Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Project-Id: 912de75d08d24473bf98cc746c209242 Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Project-Name: admin Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Role: member,admin,reader Oct 03 12:42:58.234579 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Roles: member,admin,reader Oct 03 12:42:58.249078 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_912de75d08d24473bf98cc746c209242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/912de75d08d24473bf98cc746c209242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/912de75d08d24473bf98cc746c209242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/912de75d08d24473bf98cc746c209242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:42:58.249078 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Tenant: admin Oct 03 12:42:58.249078 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Tenant-Id: 912de75d08d24473bf98cc746c209242 Oct 03 12:42:58.249078 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Tenant-Name: admin Oct 03 12:42:58.249078 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-User: admin Oct 03 12:42:58.249078 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-User-Domain-Id: default Oct 03 12:42:58.249078 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-User-Domain-Name: Default Oct 03 12:42:58.249078 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-User-Id: 77a14102256040ab81672f6adeaa6c5a Oct 03 12:42:58.249078 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-User-Name: admin Oct 03 12:42:58.249078 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: method: > Oct 03 12:42:58.249078 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: exception: Flavor 42 could not be found. Oct 03 12:42:58.249078 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: action_args: {'id': '42'} Oct 03 12:42:58.249078 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:42:58.249078 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:42:58.251782 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Oct 03 12:42:58.254569 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-634f45dc-51ea-4d85-b18f-5ab10e9174d5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:42:58.256040 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-634f45dc-51ea-4d85-b18f-5ab10e9174d5 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393437 Oct 03 12:42:58.256040 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Oct 3 12:42:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 12:42:58.256223 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-8638c800-0eb7-43c2-9b2c-76d21b24589f admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:58.270344 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-8638c800-0eb7-43c2-9b2c-76d21b24589f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027349 Oct 03 12:42:58.270918 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Oct 3 12:42:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:42:58.281700 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-d3c34916-4eb0-48d1-8569-05e290eb5da6 admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:58.305081 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-d3c34916-4eb0-48d1-8569-05e290eb5da6 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027844 Oct 03 12:42:58.305630 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Oct 3 12:42:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:42:58.315081 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-bd2c7767-1dee-4f55-a662-27a97f07a4ed admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:58.320423 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.wsgi [None req-bd2c7767-1dee-4f55-a662-27a97f07a4ed admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-bd2c7767-1dee-4f55-a662-27a97f07a4ed admin admin] Request method failure captured: Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Accept: application/json Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Accept-Encoding: gzip, deflate Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Connection: keep-alive Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Content-Length: 0 Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Host: 10.222.0.33 Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Openstack-Api-Version: compute 2.92 Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Openstack-System-Scope: None Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: User-Agent: python-novaclient Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Auth-Token: gAAAAABjOtjRN9ubbs-dgOUbNvpvIg3Nm11tqcUNY3HIaab2N-98RsH7Sfpl0PRWzFguB8oz1BT5K3MAy8lgghp-vcoF0FEC8jSqUXg9NsEN9CiuHqrNyNjV56hhjpO3BYOowQl0ieQZ-9-c7iHmEqPO-dZ9BNJuAR1oYbPrqRCIBU8CnFx0oxw Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Domain-Id: None Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Domain-Name: None Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Identity-Status: Confirmed Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Is-Admin-Project: True Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Project-Domain-Id: default Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Project-Domain-Name: Default Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Project-Id: 912de75d08d24473bf98cc746c209242 Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Project-Name: admin Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Role: member,admin,reader Oct 03 12:42:58.323774 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Roles: member,admin,reader Oct 03 12:42:58.325283 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_912de75d08d24473bf98cc746c209242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/912de75d08d24473bf98cc746c209242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/912de75d08d24473bf98cc746c209242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/912de75d08d24473bf98cc746c209242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:42:58.325283 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Tenant: admin Oct 03 12:42:58.325283 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Tenant-Id: 912de75d08d24473bf98cc746c209242 Oct 03 12:42:58.325283 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Tenant-Name: admin Oct 03 12:42:58.325283 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-User: admin Oct 03 12:42:58.325283 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-User-Domain-Id: default Oct 03 12:42:58.325283 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-User-Domain-Name: Default Oct 03 12:42:58.325283 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-User-Id: 77a14102256040ab81672f6adeaa6c5a Oct 03 12:42:58.325283 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-User-Name: admin Oct 03 12:42:58.325283 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: method: > Oct 03 12:42:58.325283 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: exception: Flavor 42 could not be found. Oct 03 12:42:58.325283 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: action_args: {'id': '42'} Oct 03 12:42:58.325283 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:42:58.325283 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:42:58.326276 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Oct 03 12:42:58.327812 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-bd2c7767-1dee-4f55-a662-27a97f07a4ed admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:42:58.329042 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-bd2c7767-1dee-4f55-a662-27a97f07a4ed admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014016 Oct 03 12:42:58.329861 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Oct 3 12:42:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 12:42:59.545528 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-d3c34916-4eb0-48d1-8569-05e290eb5da6 admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:42:59.546765 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-d3c34916-4eb0-48d1-8569-05e290eb5da6 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Oct 03 12:42:59.547205 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 12:42:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:43:00.073432 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-d20ad8b6-e2b6-4ca2-b59b-942cc182c01c admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:43:00.078414 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.wsgi [None req-d20ad8b6-e2b6-4ca2-b59b-942cc182c01c admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-d20ad8b6-e2b6-4ca2-b59b-942cc182c01c admin admin] Request method failure captured: Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Accept: application/json Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Accept-Encoding: gzip, deflate Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Connection: keep-alive Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Content-Length: 0 Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Host: 10.222.0.33 Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Openstack-Api-Version: compute 2.92 Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Openstack-System-Scope: None Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: User-Agent: python-novaclient Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Auth-Token: gAAAAABjOtjT1qE-7ZhqkeTll1jPvoQaRsDgUbbaTKT6-rQHM_SFZ-O4pLloBdZ6ZEVY7N9tq1O-HR36D7bvtAQrFkvM20TirJHc_igRsShjOxXYyfFV7Vrb_kdHkYdXRL8ZlPxdESC08BW7mYA18r2DDNgpE5K-BkA8JykQTbF1Knd5iVN0xDg Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Domain-Id: None Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Domain-Name: None Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Identity-Status: Confirmed Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Is-Admin-Project: True Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Project-Domain-Id: default Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Project-Domain-Name: Default Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Project-Id: 912de75d08d24473bf98cc746c209242 Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Project-Name: admin Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Role: member,admin,reader Oct 03 12:43:00.080523 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Roles: member,admin,reader Oct 03 12:43:00.082147 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_912de75d08d24473bf98cc746c209242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/912de75d08d24473bf98cc746c209242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/912de75d08d24473bf98cc746c209242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/912de75d08d24473bf98cc746c209242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:43:00.082147 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Tenant: admin Oct 03 12:43:00.082147 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Tenant-Id: 912de75d08d24473bf98cc746c209242 Oct 03 12:43:00.082147 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Tenant-Name: admin Oct 03 12:43:00.082147 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-User: admin Oct 03 12:43:00.082147 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-User-Domain-Id: default Oct 03 12:43:00.082147 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-User-Domain-Name: Default Oct 03 12:43:00.082147 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-User-Id: 77a14102256040ab81672f6adeaa6c5a Oct 03 12:43:00.082147 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-User-Name: admin Oct 03 12:43:00.082147 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: method: > Oct 03 12:43:00.082147 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: exception: Flavor 84 could not be found. Oct 03 12:43:00.082147 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: action_args: {'id': '84'} Oct 03 12:43:00.082147 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:43:00.082147 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:43:00.083105 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Oct 03 12:43:00.084403 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-d20ad8b6-e2b6-4ca2-b59b-942cc182c01c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:43:00.085745 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-d20ad8b6-e2b6-4ca2-b59b-942cc182c01c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.397356 Oct 03 12:43:00.085745 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Oct 3 12:42:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 03 12:43:00.091750 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-d05efb5e-5693-4c72-a4ef-81673e18e3dc admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:43:00.107657 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-d05efb5e-5693-4c72-a4ef-81673e18e3dc admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019397 Oct 03 12:43:00.108133 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Oct 3 12:43:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:43:00.117715 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-6d46503c-362b-488a-aac4-ce50164cce41 admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:43:00.133271 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-6d46503c-362b-488a-aac4-ce50164cce41 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019113 Oct 03 12:43:00.133789 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Oct 3 12:43:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:43:00.143894 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-aefa7e51-43d8-4acc-817f-5fb1e5f43006 admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:43:00.148769 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.wsgi [None req-aefa7e51-43d8-4acc-817f-5fb1e5f43006 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-aefa7e51-43d8-4acc-817f-5fb1e5f43006 admin admin] Request method failure captured: Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Accept: application/json Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Accept-Encoding: gzip, deflate Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Connection: keep-alive Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Content-Length: 0 Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Host: 10.222.0.33 Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Openstack-Api-Version: compute 2.92 Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Openstack-System-Scope: None Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: User-Agent: python-novaclient Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Auth-Token: gAAAAABjOtjT1qE-7ZhqkeTll1jPvoQaRsDgUbbaTKT6-rQHM_SFZ-O4pLloBdZ6ZEVY7N9tq1O-HR36D7bvtAQrFkvM20TirJHc_igRsShjOxXYyfFV7Vrb_kdHkYdXRL8ZlPxdESC08BW7mYA18r2DDNgpE5K-BkA8JykQTbF1Knd5iVN0xDg Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Domain-Id: None Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Domain-Name: None Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Identity-Status: Confirmed Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Is-Admin-Project: True Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Project-Domain-Id: default Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Project-Domain-Name: Default Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Project-Id: 912de75d08d24473bf98cc746c209242 Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Project-Name: admin Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Role: member,admin,reader Oct 03 12:43:00.150255 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Roles: member,admin,reader Oct 03 12:43:00.151820 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_912de75d08d24473bf98cc746c209242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/912de75d08d24473bf98cc746c209242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/912de75d08d24473bf98cc746c209242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/912de75d08d24473bf98cc746c209242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:43:00.151820 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Tenant: admin Oct 03 12:43:00.151820 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Tenant-Id: 912de75d08d24473bf98cc746c209242 Oct 03 12:43:00.151820 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Tenant-Name: admin Oct 03 12:43:00.151820 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-User: admin Oct 03 12:43:00.151820 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-User-Domain-Id: default Oct 03 12:43:00.151820 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-User-Domain-Name: Default Oct 03 12:43:00.151820 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-User-Id: 77a14102256040ab81672f6adeaa6c5a Oct 03 12:43:00.151820 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-User-Name: admin Oct 03 12:43:00.151820 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: method: > Oct 03 12:43:00.151820 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: exception: Flavor 84 could not be found. Oct 03 12:43:00.151820 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: action_args: {'id': '84'} Oct 03 12:43:00.151820 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:43:00.151820 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:43:00.152892 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Oct 03 12:43:00.154356 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-aefa7e51-43d8-4acc-817f-5fb1e5f43006 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:43:00.155683 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-aefa7e51-43d8-4acc-817f-5fb1e5f43006 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012164 Oct 03 12:43:00.155683 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Oct 3 12:43:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 12:43:01.367711 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-6d46503c-362b-488a-aac4-ce50164cce41 admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:43:01.368714 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-6d46503c-362b-488a-aac4-ce50164cce41 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 03 12:43:01.369103 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 12:43:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:43:01.889850 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-eae0d867-4f22-41c9-801d-b61caee6bba9 admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:43:01.896305 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.wsgi [None req-eae0d867-4f22-41c9-801d-b61caee6bba9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-eae0d867-4f22-41c9-801d-b61caee6bba9 admin admin] Request method failure captured: Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Accept: application/json Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Accept-Encoding: gzip, deflate Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Connection: keep-alive Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Content-Length: 0 Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Host: 10.222.0.33 Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Openstack-Api-Version: compute 2.92 Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Openstack-System-Scope: None Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: User-Agent: python-novaclient Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Auth-Token: gAAAAABjOtjVgvM8lpoEpq663g3MiScVd8zLCb8jerIGxc91MGajwNs0qIpj5spsr5XVpbUOdHsFnpjgvs6DSJvam4d8PfopkU9JDmN2QDm98KEohSoOy_7uA6xc9ZvBk76OLVYr0w6Pgy2GTKngwLBvPWrhEkf5kNVxQcFLeIRTiICCMniDYK0 Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Domain-Id: None Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Domain-Name: None Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Identity-Status: Confirmed Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Is-Admin-Project: True Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Project-Domain-Id: default Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Project-Domain-Name: Default Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Project-Id: 912de75d08d24473bf98cc746c209242 Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Project-Name: admin Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Role: member,admin,reader Oct 03 12:43:01.897781 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Roles: member,admin,reader Oct 03 12:43:01.899371 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_912de75d08d24473bf98cc746c209242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/912de75d08d24473bf98cc746c209242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/912de75d08d24473bf98cc746c209242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/912de75d08d24473bf98cc746c209242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:43:01.899371 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Tenant: admin Oct 03 12:43:01.899371 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Tenant-Id: 912de75d08d24473bf98cc746c209242 Oct 03 12:43:01.899371 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-Tenant-Name: admin Oct 03 12:43:01.899371 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-User: admin Oct 03 12:43:01.899371 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-User-Domain-Id: default Oct 03 12:43:01.899371 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-User-Domain-Name: Default Oct 03 12:43:01.899371 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-User-Id: 77a14102256040ab81672f6adeaa6c5a Oct 03 12:43:01.899371 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: X-User-Name: admin Oct 03 12:43:01.899371 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: method: > Oct 03 12:43:01.899371 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: exception: Flavor 451 could not be found. Oct 03 12:43:01.899371 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: action_args: {'id': '451'} Oct 03 12:43:01.899371 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:43:01.899371 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:43:01.900368 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: ERROR nova.api.openstack.wsgi Oct 03 12:43:01.901774 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-eae0d867-4f22-41c9-801d-b61caee6bba9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:43:01.903023 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-eae0d867-4f22-41c9-801d-b61caee6bba9 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.389307 Oct 03 12:43:01.903023 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Oct 3 12:43:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 03 12:43:01.908977 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-f40cb5df-1e51-4184-a560-aec97ccd2fe8 admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:43:01.923632 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-f40cb5df-1e51-4184-a560-aec97ccd2fe8 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018218 Oct 03 12:43:01.924147 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Oct 3 12:43:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:43:01.933786 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-0fbca5c0-4bae-4bde-bddc-ede9e226e77e admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:43:01.949076 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-0fbca5c0-4bae-4bde-bddc-ede9e226e77e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018851 Oct 03 12:43:01.949638 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Oct 3 12:43:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:43:01.959613 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-d65ad23c-b9eb-4fc3-9438-4b8291d71ceb admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:43:01.964563 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.wsgi [None req-d65ad23c-b9eb-4fc3-9438-4b8291d71ceb admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-d65ad23c-b9eb-4fc3-9438-4b8291d71ceb admin admin] Request method failure captured: Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Accept: application/json Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Accept-Encoding: gzip, deflate Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Connection: keep-alive Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Content-Length: 0 Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Host: 10.222.0.33 Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Openstack-Api-Version: compute 2.92 Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Openstack-System-Scope: None Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: User-Agent: python-novaclient Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Auth-Token: gAAAAABjOtjVgvM8lpoEpq663g3MiScVd8zLCb8jerIGxc91MGajwNs0qIpj5spsr5XVpbUOdHsFnpjgvs6DSJvam4d8PfopkU9JDmN2QDm98KEohSoOy_7uA6xc9ZvBk76OLVYr0w6Pgy2GTKngwLBvPWrhEkf5kNVxQcFLeIRTiICCMniDYK0 Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Domain-Id: None Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Domain-Name: None Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Identity-Status: Confirmed Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Is-Admin-Project: True Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Project-Domain-Id: default Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Project-Domain-Name: Default Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Project-Id: 912de75d08d24473bf98cc746c209242 Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Project-Name: admin Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Role: member,admin,reader Oct 03 12:43:01.966078 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Roles: member,admin,reader Oct 03 12:43:01.967650 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_912de75d08d24473bf98cc746c209242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/912de75d08d24473bf98cc746c209242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/912de75d08d24473bf98cc746c209242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/912de75d08d24473bf98cc746c209242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:43:01.967650 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Tenant: admin Oct 03 12:43:01.967650 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Tenant-Id: 912de75d08d24473bf98cc746c209242 Oct 03 12:43:01.967650 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-Tenant-Name: admin Oct 03 12:43:01.967650 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-User: admin Oct 03 12:43:01.967650 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-User-Domain-Id: default Oct 03 12:43:01.967650 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-User-Domain-Name: Default Oct 03 12:43:01.967650 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-User-Id: 77a14102256040ab81672f6adeaa6c5a Oct 03 12:43:01.967650 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: X-User-Name: admin Oct 03 12:43:01.967650 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: method: > Oct 03 12:43:01.967650 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: exception: Flavor 451 could not be found. Oct 03 12:43:01.967650 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: action_args: {'id': '451'} Oct 03 12:43:01.967650 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:43:01.967650 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:43:01.968773 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: ERROR nova.api.openstack.wsgi Oct 03 12:43:01.970102 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-d65ad23c-b9eb-4fc3-9438-4b8291d71ceb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:43:01.971449 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-d65ad23c-b9eb-4fc3-9438-4b8291d71ceb admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011359 Oct 03 12:43:01.971449 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Oct 3 12:43:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 12:43:03.184734 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-0fbca5c0-4bae-4bde-bddc-ede9e226e77e admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:43:03.185745 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-0fbca5c0-4bae-4bde-bddc-ede9e226e77e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 03 12:43:03.186140 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 12:43:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:43:03.710140 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-2077c2c5-a368-4e4a-9cea-91a2e91305dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:43:03.818513 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-2077c2c5-a368-4e4a-9cea-91a2e91305dc admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.492491 Oct 03 12:43:03.819058 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Oct 3 12:43:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:43:05.053632 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-0fbca5c0-4bae-4bde-bddc-ede9e226e77e admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:43:05.054628 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-0fbca5c0-4bae-4bde-bddc-ede9e226e77e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Oct 03 12:43:05.055019 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 12:43:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:43:05.581541 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-f074bb5a-0377-4083-891d-ae670753966e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:43:05.681085 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-f074bb5a-0377-4083-891d-ae670753966e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.486367 Oct 03 12:43:05.681641 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Oct 3 12:43:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:43:06.921914 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-0fbca5c0-4bae-4bde-bddc-ede9e226e77e admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:43:06.923665 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-0fbca5c0-4bae-4bde-bddc-ede9e226e77e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 03 12:43:06.924061 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 12:43:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:43:07.453008 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-0048dffc-3707-4e55-93ef-b49491116ba3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:43:07.549357 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-0048dffc-3707-4e55-93ef-b49491116ba3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.480343 Oct 03 12:43:07.549894 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Oct 3 12:43:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:43:08.757553 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-0fbca5c0-4bae-4bde-bddc-ede9e226e77e admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:43:08.758583 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-0fbca5c0-4bae-4bde-bddc-ede9e226e77e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 03 12:43:08.758975 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 12:43:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:43:09.279251 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-b040d114-d51a-424e-9a0c-51d32dca5801 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:43:09.378424 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-b040d114-d51a-424e-9a0c-51d32dca5801 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.482798 Oct 03 12:43:09.378911 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Oct 3 12:43:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:43:10.615947 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-0fbca5c0-4bae-4bde-bddc-ede9e226e77e admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:43:10.616947 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-0fbca5c0-4bae-4bde-bddc-ede9e226e77e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 03 12:43:10.617350 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 12:43:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:43:11.132052 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-10037954-6806-436c-8f46-4635678c56ab admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:43:11.152211 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-10037954-6806-436c-8f46-4635678c56ab admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.398885 Oct 03 12:43:11.152748 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Mon Oct 3 12:43:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:44:08.591042 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-0fbca5c0-4bae-4bde-bddc-ede9e226e77e admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:44:08.592251 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-0fbca5c0-4bae-4bde-bddc-ede9e226e77e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 03 12:44:08.592576 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 12:44:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:44:08.603542 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG dbcounter [-] [112500] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:44:08.986959 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-c1d4af2b-daed-4561-8c4a-080ce8c9266f admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:44:09.007109 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-c1d4af2b-daed-4561-8c4a-080ce8c9266f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.408397 Oct 03 12:44:09.007672 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1292 bytes} [Mon Oct 3 12:44:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:44:09.028238 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG dbcounter [-] [112501] Writing DB stats nova_api:SELECT=14 {{(pid=112501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:44:09.031954 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-7cc26bca-b7b5-4da7-931d-9351afdcc745 admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:44:09.039890 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-7cc26bca-b7b5-4da7-931d-9351afdcc745 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013049 Oct 03 12:44:09.040414 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1283 bytes} [Mon Oct 3 12:44:09 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:44:09.052704 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-e404f981-74f3-4afd-8836-c3bba53d34d7 admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:44:09.060073 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-e404f981-74f3-4afd-8836-c3bba53d34d7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011932 Oct 03 12:44:09.060686 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1286 bytes} [Mon Oct 3 12:44:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:44:09.072298 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-04544a02-1ae1-41fe-a91a-199c4ba8ae82 admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:44:09.079431 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-04544a02-1ae1-41fe-a91a-199c4ba8ae82 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010884 Oct 03 12:44:09.080305 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1286 bytes} [Mon Oct 3 12:44:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:44:09.091056 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-769103a2-dc98-4465-80a4-f2548eaf2adf admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:44:09.099065 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-769103a2-dc98-4465-80a4-f2548eaf2adf admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011665 Oct 03 12:44:09.099615 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1283 bytes} [Mon Oct 3 12:44:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:47:26.855593 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-04544a02-1ae1-41fe-a91a-199c4ba8ae82 admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:47:26.856278 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-04544a02-1ae1-41fe-a91a-199c4ba8ae82 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Oct 03 12:47:26.856693 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 12:47:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:47:26.996235 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG dbcounter [-] [112500] Writing DB stats nova_api:SELECT=6 {{(pid=112500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:47:27.155295 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-9a974101-2c73-4b3e-bcf5-e7613f930460 admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:47:27.159955 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-9a974101-2c73-4b3e-bcf5-e7613f930460 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:47:27.160427 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-9a974101-2c73-4b3e-bcf5-e7613f930460 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:47:27.160851 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-9a974101-2c73-4b3e-bcf5-e7613f930460 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:47:27.161549 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-9a974101-2c73-4b3e-bcf5-e7613f930460 admin admin] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:47:27.161992 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-9a974101-2c73-4b3e-bcf5-e7613f930460 admin admin] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:47:27.162402 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-9a974101-2c73-4b3e-bcf5-e7613f930460 admin admin] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:47:27.193308 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-9a974101-2c73-4b3e-bcf5-e7613f930460 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.198479 Oct 03 12:47:27.193857 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Oct 3 12:47:26 2022] GET /compute/v2.1/os-services => generated 794 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:47:28.293974 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-04544a02-1ae1-41fe-a91a-199c4ba8ae82 admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:47:28.294950 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-04544a02-1ae1-41fe-a91a-199c4ba8ae82 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 Oct 03 12:47:28.295390 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 12:47:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:47:28.489713 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-ea80fc57-a5ed-4941-904f-3d8dbda71c62 admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:47:28.493033 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-ea80fc57-a5ed-4941-904f-3d8dbda71c62 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:47:28.493516 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-ea80fc57-a5ed-4941-904f-3d8dbda71c62 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:47:28.493945 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-ea80fc57-a5ed-4941-904f-3d8dbda71c62 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:47:28.494657 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-ea80fc57-a5ed-4941-904f-3d8dbda71c62 admin admin] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:47:28.495177 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-ea80fc57-a5ed-4941-904f-3d8dbda71c62 admin admin] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:47:28.495618 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-ea80fc57-a5ed-4941-904f-3d8dbda71c62 admin admin] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:47:28.514684 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-ea80fc57-a5ed-4941-904f-3d8dbda71c62 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.077041 Oct 03 12:47:28.515229 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Oct 3 12:47:28 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:47:40.036779 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-04544a02-1ae1-41fe-a91a-199c4ba8ae82 admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:47:40.037771 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-04544a02-1ae1-41fe-a91a-199c4ba8ae82 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Oct 03 12:47:40.038166 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 12:47:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:47:40.179809 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG dbcounter [-] [112500] Writing DB stats nova_cell0:SELECT=4 {{(pid=112500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:47:40.180570 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG dbcounter [-] [112500] Writing DB stats nova_cell1:SELECT=4 {{(pid=112500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:47:40.181216 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG dbcounter [-] [112500] Writing DB stats nova_api:SELECT=8 {{(pid=112500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:47:40.229706 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-3c16bf8b-f6f5-4c43-bdf6-2b0a6892c56a admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:47:40.233437 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-3c16bf8b-f6f5-4c43-bdf6-2b0a6892c56a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:47:40.233924 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-3c16bf8b-f6f5-4c43-bdf6-2b0a6892c56a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:47:40.234359 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-3c16bf8b-f6f5-4c43-bdf6-2b0a6892c56a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:47:40.235082 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-3c16bf8b-f6f5-4c43-bdf6-2b0a6892c56a admin admin] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:47:40.235561 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-3c16bf8b-f6f5-4c43-bdf6-2b0a6892c56a admin admin] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:47:40.235987 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-3c16bf8b-f6f5-4c43-bdf6-2b0a6892c56a admin admin] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:47:40.262920 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-3c16bf8b-f6f5-4c43-bdf6-2b0a6892c56a admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.087498 Oct 03 12:47:40.263526 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 38/74] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Oct 3 12:47:40 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:47:41.379811 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG nova.api.openstack.wsgi [None req-04544a02-1ae1-41fe-a91a-199c4ba8ae82 admin admin] Calling method '>' {{(pid=112501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:47:41.380809 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: INFO nova.api.openstack.requestlog [None req-04544a02-1ae1-41fe-a91a-199c4ba8ae82 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 03 12:47:41.381200 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: [pid: 112501|app: 0|req: 37/75] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 12:47:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:47:41.584649 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG nova.api.openstack.wsgi [None req-1ee5b504-0067-4eb4-abcf-1625313e06c2 admin admin] Calling method '>' {{(pid=112500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:47:41.588138 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-1ee5b504-0067-4eb4-abcf-1625313e06c2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:47:41.588616 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-1ee5b504-0067-4eb4-abcf-1625313e06c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:47:41.589155 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-1ee5b504-0067-4eb4-abcf-1625313e06c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:47:41.589896 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-1ee5b504-0067-4eb4-abcf-1625313e06c2 admin admin] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:47:41.590350 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-1ee5b504-0067-4eb4-abcf-1625313e06c2 admin admin] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:47:41.590770 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: DEBUG oslo_concurrency.lockutils [None req-1ee5b504-0067-4eb4-abcf-1625313e06c2 admin admin] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:47:41.613438 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: INFO nova.api.openstack.requestlog [None req-1ee5b504-0067-4eb4-abcf-1625313e06c2 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.092889 Oct 03 12:47:41.613994 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: [pid: 112500|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Oct 3 12:47:41 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:48:40.292728 dv-cinder-844563-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 03 12:48:40.293291 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: Mon Oct 3 12:48:40 2022 - graceful shutdown triggered... Oct 03 12:48:40.293716 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: Gracefully killing worker 2 (pid: 112501)... Oct 03 12:48:40.294095 dv-cinder-844563-12-iscsi devstack@n-api.service[112500]: Gracefully killing worker 1 (pid: 112500)... Oct 03 12:48:40.422567 dv-cinder-844563-12-iscsi devstack@n-api.service[112501]: DEBUG dbcounter [-] [112501] Writing DB stats nova_api:SELECT=4 {{(pid=112501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:41.294191 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: worker 1 buried after 1 seconds Oct 03 12:48:41.294652 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: worker 2 buried after 1 seconds Oct 03 12:48:41.294652 dv-cinder-844563-12-iscsi devstack@n-api.service[112499]: goodbye to uWSGI. Oct 03 12:48:41.296041 dv-cinder-844563-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 03 12:48:41.296852 dv-cinder-844563-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 03 12:48:41.299885 dv-cinder-844563-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 03 12:48:41.309182 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 03 12:48:41.311205 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 3 12:48:41 2022] *** Oct 03 12:48:41.311205 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 03 12:48:41.311205 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 03 12:48:41.311205 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: nodename: dv-cinder-844563-12-iscsi Oct 03 12:48:41.311205 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: machine: x86_64 Oct 03 12:48:41.311205 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: clock source: unix Oct 03 12:48:41.311205 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: pcre jit disabled Oct 03 12:48:41.311205 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: detected number of CPU cores: 4 Oct 03 12:48:41.311205 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: current working directory: / Oct 03 12:48:41.311205 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: detected binary path: /usr/bin/uwsgi-core Oct 03 12:48:41.311205 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: your processes number limit is 47680 Oct 03 12:48:41.312109 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: your memory page size is 4096 bytes Oct 03 12:48:41.312109 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: detected max file descriptor number: 2048 Oct 03 12:48:41.312109 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: lock engine: pthread robust mutexes Oct 03 12:48:41.312109 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: thunder lock: enabled Oct 03 12:48:41.312109 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 03 12:48:41.312109 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 03 12:48:41.356583 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: Python main interpreter initialized at 0x56077d6479c0 Oct 03 12:48:41.356583 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: python threads support enabled Oct 03 12:48:41.356583 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: your server socket listen backlog is limited to 100 connections Oct 03 12:48:41.356583 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: your mercy for graceful operations on workers is 90 seconds Oct 03 12:48:41.357048 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: mapped 403077 bytes (393 KB) for 2 cores Oct 03 12:48:41.357048 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: *** Operational MODE: preforking *** Oct 03 12:48:41.357356 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: *** uWSGI is running in multiple interpreter mode *** Oct 03 12:48:41.357356 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: spawned uWSGI master process (pid: 127521) Oct 03 12:48:41.357556 dv-cinder-844563-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 03 12:48:41.363471 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: spawned uWSGI worker 1 (pid: 127542, cores: 1) Oct 03 12:48:41.363471 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: spawned uWSGI worker 2 (pid: 127544, cores: 1) Oct 03 12:48:41.363471 dv-cinder-844563-12-iscsi devstack@n-api.service[127521]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 03 12:48:42.021691 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 12:48:42.027856 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 12:48:43.203191 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 12:48:43.203191 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: from cryptography.utils import int_from_bytes Oct 03 12:48:43.203864 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 12:48:43.203864 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: from cryptography.utils import int_from_bytes Oct 03 12:48:43.209175 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 12:48:43.209175 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: from cryptography.utils import int_from_bytes Oct 03 12:48:43.209652 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 12:48:43.209652 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: from cryptography.utils import int_from_bytes Oct 03 12:48:45.630490 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 12:48:45.631003 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 12:48:45.631275 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 12:48:45.631614 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 12:48:45.631875 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 12:48:45.632272 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.632608 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.632936 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.633261 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.633598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.633949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.634251 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.634574 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.634905 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.635170 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.635514 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.635996 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-12-iscsi {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.636328 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.636646 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.636964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.637293 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.637604 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.637935 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.638259 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.638771 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.640312 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.640312 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.640312 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.640581 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 12:48:45.640581 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 12:48:45.641010 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.641010 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.641162 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 12:48:45.641239 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.641323 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 12:48:45.641403 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.641482 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 12:48:45.641560 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.641640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.641747 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.642985 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.643220 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.643473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.643714 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-12-iscsi {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.643944 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.644193 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.644468 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.644670 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.644915 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.645166 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.645382 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.645382 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.645825 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.646044 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.646250 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.646477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.646696 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.646911 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.647124 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.647446 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-12-iscsi {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.647888 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.647888 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.648193 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.648193 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.648444 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.648556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.648707 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.648832 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.648951 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.649068 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.649187 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.649312 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.649470 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.649590 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.649701 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.649701 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.649928 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.650062 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.650188 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.650306 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.650429 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.650541 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.650650 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.650864 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.650992 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.651112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.651222 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.651360 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.654426 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.654598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.654763 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.654914 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.655076 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.655230 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.655230 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.655610 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.655765 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.655919 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.656065 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.656219 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-12-iscsi {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.656377 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.656521 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.656671 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.656815 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.656959 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.657119 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.657289 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.657435 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.657587 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.657733 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.657948 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.658210 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.658510 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.658701 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.658849 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.659001 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.659146 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.659310 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.659537 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.659702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.659866 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.660020 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.660174 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.660330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.660481 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.660633 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.660778 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.660928 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.661073 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.661229 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.661397 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.661553 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.662160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.662344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.662597 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.662754 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.662899 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.663042 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.663194 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.663368 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.663635 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.663807 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.663964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.664109 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.664271 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.664417 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.664576 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.664721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.664721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.665013 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.665164 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.665393 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.665542 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.665696 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.665848 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.665994 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.666157 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.666315 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.666467 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.666621 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.666765 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.666909 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.667062 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.667206 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.667380 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.667539 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.667686 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.667837 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.667990 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.668146 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.668297 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.668488 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.668640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.668786 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.668942 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.669097 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.669254 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.669399 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.669399 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.669685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.669973 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.670219 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.670377 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.670528 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.670673 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.670827 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.670994 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.671139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.671291 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.671527 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.671682 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.671869 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.672363 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.672516 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.672782 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.672942 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.673095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.673255 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.673401 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.673553 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.673815 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.673968 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.674120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.674271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.674424 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.674575 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.674733 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.674889 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.675817 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.675973 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.676119 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.676263 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.676417 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.676562 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.676712 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.676866 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.677011 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.677163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.677318 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.677462 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.677629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.677786 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.677937 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.678097 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.678251 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.678403 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.678558 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.678914 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.679061 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.679411 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.679568 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.679713 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.679876 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.680066 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.680264 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.680427 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.680580 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.680724 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.680867 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.681018 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.681171 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.681336 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.681336 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.681627 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.681778 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.681930 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.682117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.682643 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.682826 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.683064 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.683286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.683489 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.683687 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.683869 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.684105 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.684265 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.684413 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.684565 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.684729 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.684729 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.685009 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.685186 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.685402 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.685553 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.685706 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.685851 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.686002 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.686156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.686307 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.686460 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.686616 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.686771 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.686926 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.687071 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.687229 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.687403 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.687554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.687709 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.687869 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.688021 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.688177 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.688322 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.688473 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.688629 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.688782 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.689461 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.689705 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.689871 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.690029 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.690183 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.690183 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.690522 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.690676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.690821 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.690971 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.691130 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.691287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.691498 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.691643 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.691798 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.691943 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.692096 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.692248 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.692410 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.692844 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.692991 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.693248 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.693418 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.693572 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.693736 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.693893 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:48:45.694038 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.694282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.694452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.694681 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.694835 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.694980 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.695124 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.695267 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.695516 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.695680 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.695845 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.695991 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.696146 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.696298 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.696457 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.696602 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.696746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.696898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.697043 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.697193 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.697351 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.697502 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.697647 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.697800 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.697952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.698097 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.698255 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.698407 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.698560 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.698715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.698867 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.699019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.699178 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.699350 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.699512 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.699657 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.699817 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.699973 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.700130 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.700282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.700469 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.700627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.700772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.700930 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.701085 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.701238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.701390 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.701534 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.701685 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.701854 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.702007 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.702150 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.702295 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.702438 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.702609 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.703053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.703210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.703524 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.703689 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.703843 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.703996 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.704171 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.704334 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.704565 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.705271 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.705427 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.705674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.705826 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.705978 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.706122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.706272 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.706425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.706580 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.706725 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.706888 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.707033 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.707178 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.707341 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.707510 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.707655 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.707806 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.707951 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.708142 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.708301 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.708460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.708606 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.708750 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.708912 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.709065 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.709220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.709372 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.709524 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.709687 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.709841 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.709989 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.710198 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.710359 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.710548 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.710715 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.710860 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.711015 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.711169 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.711353 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.711517 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.711663 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.711807 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.711951 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.712112 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.712257 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.712409 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.712553 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.712698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.713170 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.713325 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.713471 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.713723 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.713875 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.714020 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.714178 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.714331 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.714483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.714746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.714908 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.715053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.715208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.715394 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.715394 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.715691 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.715919 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.716077 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.716233 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.716389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.716541 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.716693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.716940 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.717100 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.717246 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.717390 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.717551 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.717697 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.717840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.717995 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.718147 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.718300 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.718452 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.718598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.718750 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.718905 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.719050 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.719204 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.719367 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.719533 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.719688 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.719851 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.719999 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.720153 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.720361 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.720593 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.720758 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.720905 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.721056 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.721210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.721361 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.721517 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.721671 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.721823 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.721967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.722111 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.722254 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.722405 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.722563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.722716 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.722869 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.723403 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.723560 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.723705 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.723873 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.724134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.724296 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.724449 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.724594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.724772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.725015 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.725164 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.725309 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.725454 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.725597 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.725821 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.726056 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.726218 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.726363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.726515 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.726659 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.726818 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.726969 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.727122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.727274 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.727475 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.727621 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.727779 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.727931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.728084 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.728239 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.728239 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.728521 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.728679 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.728824 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.728966 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.729109 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.729252 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.729410 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.729555 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.729698 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.729854 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.730003 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.730156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.730310 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.730462 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.730661 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.730822 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.730967 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.731110 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.731267 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.731555 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.731703 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.731703 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.731994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.732155 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.732308 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.732464 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.732609 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.732753 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.732895 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.733053 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.733507 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.733669 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.733822 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.733975 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.734146 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.734647 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.734810 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.734956 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.735202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.735371 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.735523 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.735727 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.736424 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.736670 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.736878 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.737073 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.737220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.737381 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.737535 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.737700 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.737847 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.737991 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.738145 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.738290 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.738441 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.738586 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.738730 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.738882 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.739041 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.739187 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.739372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.739536 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.739699 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.739852 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.740010 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.740155 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.740304 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.740504 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.740653 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.740841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.740999 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.741145 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.741288 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.741431 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.741573 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.741727 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.741879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.742032 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.742185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.742337 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.742482 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.742640 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.742785 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.742936 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.743087 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.743241 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.743733 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.743896 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.744060 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.744216 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.744503 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.744664 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.744809 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.744967 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.745119 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.745379 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.745538 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.745692 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.745835 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.745989 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.746152 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.746314 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.746475 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.746620 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.746866 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.747023 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.747175 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.747378 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.747532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.747694 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.747856 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.748007 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.748157 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.748324 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.748476 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.748624 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.748787 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.748946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.749096 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.749245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.749395 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.749544 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.749703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.749861 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.750010 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.750167 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.750336 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.750501 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.750651 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.750800 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.750998 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.751156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.751329 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.751564 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.752231 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.752468 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.752664 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.752827 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.752985 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.753167 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.753318 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.753476 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.753952 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.753952 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.754256 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.754430 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.754741 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.754909 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.755069 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.755219 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.755219 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.755686 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.755845 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.756004 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.756153 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.756302 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.756462 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.756627 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.756779 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.757023 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.757181 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.757331 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.757488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.757646 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.757810 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.757974 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.758125 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.758275 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.758431 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.758589 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.758748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.758909 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.759073 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.759224 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.759392 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.759548 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.759697 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.759874 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.760027 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.760183 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.760349 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.760701 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.760996 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.761169 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.761332 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.761491 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.761660 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.761814 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.761974 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.762127 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.762289 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.762447 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.762447 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.762742 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.762906 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.763059 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.763208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.763394 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.763552 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.763713 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.764165 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.764325 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.764487 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.764656 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.764921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.765087 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.765249 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.765400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.765567 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.765811 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.765967 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.766117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.766275 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.766434 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.766594 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.766771 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.766923 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.767182 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.767390 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.767555 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.767904 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.768066 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.768225 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.768386 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.768545 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.768703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.768868 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.769018 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.769188 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.769340 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.769498 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.769648 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.769807 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.769957 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.770155 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.770320 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.770483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.770634 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.770806 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.770947 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.771131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.771287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.771470 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.771621 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.771784 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.771935 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.772084 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.772241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.772391 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.772556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.772706 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.772861 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.773011 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.773179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.773330 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.773494 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.773646 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.773801 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.773977 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.774422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.774585 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.774746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.774924 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.775166 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.775341 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.775499 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.775675 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.775844 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.776083 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.776239 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.776398 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.776562 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.776729 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.776887 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.777047 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.777290 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.777456 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.777607 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.777773 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.777942 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.778101 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.778260 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.778412 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.778562 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.778723 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.778874 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.779033 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.779185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.779388 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.779563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.779722 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.779885 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.780035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.780193 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.780350 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.780516 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.780668 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.780817 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.780976 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.781177 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.781341 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.781511 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.781670 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.781820 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.781997 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.782155 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.782306 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.782469 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.782627 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.782831 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.783150 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.783346 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.783524 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.783685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.783882 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.784045 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.784572 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.784745 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.784907 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.785069 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.785333 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.785493 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.785644 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.785803 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.785965 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.786142 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.786386 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.786542 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.786693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.786850 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.787030 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.787183 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.787455 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.787614 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.787777 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.787940 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.787940 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.788249 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.788405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.788405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.788690 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.788855 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.788855 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.789162 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.789321 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.789472 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.789629 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.789790 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.789947 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.790099 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.790256 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.790408 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.790567 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.790728 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.790885 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.791047 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.791242 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.791431 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.791584 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.791745 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.791895 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.791895 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.792188 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.792338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.792498 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.792650 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.792800 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.792950 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.793119 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.793272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.793438 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.793595 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.793795 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.793959 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.794111 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.794261 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.794694 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.794860 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.795021 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.795179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.795371 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.795624 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.795792 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.795944 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.796094 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.796252 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.796252 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.796654 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.796811 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.796962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.797111 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.797261 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.797435 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.797670 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.797837 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.797997 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.798148 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.798299 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.798973 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.799248 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.799510 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.799678 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.799839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.799839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.800158 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.800389 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.800557 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.800729 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.800890 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.801060 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.801222 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.801417 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.801568 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.801718 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.801876 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.802034 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.802195 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.802353 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.802505 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.802673 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.802832 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.802992 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.803152 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.803303 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.803481 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.803642 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.803794 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.803952 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.804116 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.804275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.804425 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.804850 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.805022 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.805184 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.805336 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.805493 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.805669 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.805909 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.806066 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.806235 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.806395 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.806546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.806796 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.806954 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.806954 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.807272 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.807458 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.807611 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.807856 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.808020 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.808173 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.808337 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.808496 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.808647 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.808804 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.808955 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.809119 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.809119 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.809443 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.809443 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.809745 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.809897 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.810055 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.810215 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.810374 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.810533 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.810691 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.810691 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.811000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.811160 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.811401 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.811572 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.811723 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.811881 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.812042 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.812193 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.812344 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.812503 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.812663 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.812828 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.812982 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.813140 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.813292 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.813462 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.813614 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.813774 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.813926 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.814157 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.814157 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.814581 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.815032 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.815205 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.815379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.815538 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.815689 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.815851 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.816119 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.816293 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.816446 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.816446 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.816743 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.817007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.817265 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.817424 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.817585 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.817736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.817975 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.818148 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.818320 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.818473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.818625 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.818777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.818944 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.819095 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.819246 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.819432 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.819594 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.819746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.819746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.820050 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.820200 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.820361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.820520 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.820679 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.820845 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.820845 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.821162 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.822536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.822705 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.822866 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.823303 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.823489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.823670 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.823824 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.824031 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.824190 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.824349 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.824513 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.824747 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.825237 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.825399 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.825551 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.825701 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.825860 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.826028 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.826201 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.826478 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.826636 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.826787 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.826953 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.827230 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.827452 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.827607 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.827758 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.827908 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.828175 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.828342 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.828514 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.828674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.828833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.828984 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.829150 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.829302 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.829459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.830139 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.830307 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.830614 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.830785 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.830946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.831104 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.831104 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.831452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.831734 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.831905 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.832066 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.832218 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.832377 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.832527 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.832693 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.832888 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.833098 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.833306 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.833461 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.833625 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.833790 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.833986 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.834145 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.834304 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.834457 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.834608 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.834773 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.834773 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.835517 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.835727 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.835893 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.836056 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.836220 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.836419 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.836697 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.836863 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.837016 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.837455 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.837620 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.837780 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.837932 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.838101 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.838389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.838567 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.838733 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.838891 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.839050 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.839209 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.839381 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.839552 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.839782 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.839958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.840096 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.840235 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.840389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.840482 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.840577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.840577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.840722 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.840722 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.840975 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.841083 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.841172 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.841264 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.841359 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.841451 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.841551 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.841652 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.841793 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.841886 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.841972 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.842065 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.842160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.842253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.842347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.842434 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.842532 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.842683 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.842783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.842878 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.843013 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.843150 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.843249 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.843433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.843537 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.843636 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.843636 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.843817 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.843911 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.844011 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.844098 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.844190 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.844283 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.844369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.844507 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.844507 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.844688 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.844772 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.844865 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.844951 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.845046 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.845159 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.846044 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.846140 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.846226 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.846319 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.846420 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.846516 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.846516 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.846687 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.846785 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.846873 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.846973 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.847069 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.847164 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.847259 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.847362 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.847630 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.847745 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.847846 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.847935 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.848032 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.848032 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.848186 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.848267 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.848358 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.848434 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.848434 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.848598 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.848598 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.848778 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.848778 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.848954 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.849051 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.849138 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.849236 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.849324 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.849416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.849502 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.849595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.849691 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.849778 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.849873 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.849873 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.850037 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.850130 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.850228 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.850317 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.850406 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.850480 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.850480 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.850657 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.850887 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.851019 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.851132 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.851132 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.851401 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.851612 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.851733 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.851890 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.851890 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.852117 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.852239 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.852239 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.852458 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.852580 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.852580 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.852580 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.852895 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.853016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.853135 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.853249 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.853249 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.853449 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.853551 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.853640 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.853742 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.853742 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.853907 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.853992 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.854086 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.854173 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.854264 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.854357 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.854451 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.854557 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.854652 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.854746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.854833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.854925 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.855011 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.855104 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.855191 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.855275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.855374 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.855469 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.855555 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.855652 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.855740 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.855837 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.855930 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.856196 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.856196 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.856412 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.856499 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.856572 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.856650 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.856722 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.856803 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.856877 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.856956 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.857029 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.857099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.857182 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.857264 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.857344 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.857424 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.857503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.857843 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.857965 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.858087 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.858199 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.858312 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.858422 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.858543 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.858670 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.858783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.858902 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.859025 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.859137 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.859255 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.859255 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.859775 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.859888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.860001 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.860111 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.860235 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.860356 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.860475 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.860587 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.860706 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.860825 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.861026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.861220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.861388 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.861533 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.861642 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.861725 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.861809 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.863436 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.863586 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.863742 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.863892 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.864029 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.864183 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.864335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.864473 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.864609 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.864751 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.864892 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.865042 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.865175 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.865175 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.865410 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.865410 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.865572 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.865661 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.865743 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.865743 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.865893 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.865965 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.866049 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.866129 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.866207 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.866301 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.866375 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.866447 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.866528 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.866602 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.866679 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.866764 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.866878 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.866878 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.866878 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.866878 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.867436 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.867578 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.867723 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.867855 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.868005 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.868137 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.868279 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.868425 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.868516 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.868600 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.868682 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.868770 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.868844 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.868923 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.869004 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.869087 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.869161 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.869240 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.869312 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.869383 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.869460 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.869460 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.869600 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.869671 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.869671 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.869805 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.869878 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.869878 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.870017 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.870017 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.870157 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.870157 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.870303 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.870303 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.870433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.870513 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.870592 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.870669 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.870754 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.870848 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.870932 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.871013 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.871085 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.871157 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.871242 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.871580 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.871685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.871770 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.871770 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.871909 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.871992 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.872066 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.872144 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.872223 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.872307 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.872456 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.872533 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.872604 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.872604 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.872744 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.872816 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.872902 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.872902 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.873041 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.873114 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.873184 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.873262 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.873262 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.873410 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.873490 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.873564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.873643 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.873643 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.873783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.873855 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.873855 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.873990 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.874061 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.874061 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.874207 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.874287 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.874287 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.874417 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.874488 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.874568 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.874648 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.874648 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.874785 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.874864 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.874864 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.875992 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.876099 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.876099 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.876233 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.876319 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.876319 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.876500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.876585 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.876953 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.877050 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.877989 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.878114 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.878217 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.878310 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.878385 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.878622 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.878739 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.878960 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.879285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.879410 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.879646 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.879934 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.880046 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.880295 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.880593 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.880702 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.880945 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.881175 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.881280 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.881629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.881788 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.881971 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.882309 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.882415 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.882627 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.882944 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.883140 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.883264 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.883506 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.883623 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.884001 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.884119 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.884252 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.884345 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.884568 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.884672 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.884882 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.884977 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.885202 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.885295 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.885516 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.885621 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.885838 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.886109 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.886208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.886307 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.886449 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.886545 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.886767 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.886870 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.887079 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.887180 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.887412 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.887524 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.887728 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.887830 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.888042 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.888137 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.888354 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.888457 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.888668 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.888770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.888986 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.889090 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.889300 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.889394 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.889619 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.889725 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.889929 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.890090 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.890239 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.890333 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.890550 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.890651 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.890862 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.890967 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.891170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.891265 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.891506 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.891602 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.891817 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.891928 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.892649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.892757 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.892987 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.893089 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.893297 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.893392 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.893610 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.893726 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.893920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.894061 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.894229 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.894393 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.894539 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.894714 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.894847 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.895060 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.895163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.895473 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.895588 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.895780 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.895896 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.896084 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.896321 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.896427 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.896524 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.896731 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.896825 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.897049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.897142 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.897378 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.897471 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.897696 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.897789 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.898016 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.898117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.898329 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.898423 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.898655 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.898757 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.898979 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.899080 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.899301 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.899431 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.899637 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.899741 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.899980 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.900123 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.900293 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.900442 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.900610 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.900714 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.900926 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.901025 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.901237 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.901337 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.901552 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.901727 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.901864 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.901963 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.902184 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.902286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.902505 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.902610 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.902814 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.902906 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.903142 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.903249 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.903497 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.903595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.903826 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.903921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.904143 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.904244 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.904457 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.904557 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.904790 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.904891 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.905103 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.905246 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.905418 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.905514 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.905730 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.905831 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.906044 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.906163 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.906362 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.906494 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.906683 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.906789 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.906996 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.907111 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.907311 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 12:48:45.907477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.907654 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.908545 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.908967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.909306 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.909622 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.909955 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.910284 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.910636 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.910955 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.911303 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.911657 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.911979 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.912292 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.912599 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:48:45.912843 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 12:48:45.969586 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO dbcounter [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] Registered counter for database nova_api Oct 03 12:48:45.974560 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO dbcounter [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] Registered counter for database nova_api Oct 03 12:48:45.990747 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_db.sqlalchemy.engines [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:48:45.994548 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_db.sqlalchemy.engines [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:48:45.997780 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writer thread running {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:48:46.001097 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writer thread running {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:48:46.054706 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.context [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57c6aefa-012f-4d1a-b081-6750fab41575(cell1) {{(pid=127544) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 12:48:46.056826 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.context [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57c6aefa-012f-4d1a-b081-6750fab41575(cell1) {{(pid=127542) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 12:48:46.058758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:48:46.059248 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:48:46.060792 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:48:46.060907 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:48:46.061269 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:48:46.061582 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:48:46.062044 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:48:46.062829 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:48:46.063601 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:48:46.064166 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:48:46.064855 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:48:46.066226 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:48:46.066326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO dbcounter [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] Registered counter for database nova_cell0 Oct 03 12:48:46.068231 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO dbcounter [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] Registered counter for database nova_cell0 Oct 03 12:48:46.070421 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO dbcounter [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] Registered counter for database nova_cell1 Oct 03 12:48:46.072337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO dbcounter [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] Registered counter for database nova_cell1 Oct 03 12:48:46.078112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_db.sqlalchemy.engines [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:48:46.080758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_db.sqlalchemy.engines [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:48:46.084898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_db.sqlalchemy.engines [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:48:46.085843 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_db.sqlalchemy.engines [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:48:46.087436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writer thread running {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:48:46.088751 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writer thread running {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:48:46.090966 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writer thread running {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:48:46.093699 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writer thread running {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:48:46.237532 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO dbcounter [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] Registered counter for database nova_cell0 Oct 03 12:48:46.242327 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_db.sqlalchemy.engines [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:48:46.246271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO dbcounter [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] Registered counter for database nova_cell0 Oct 03 12:48:46.247526 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writer thread running {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:48:46.255079 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_db.sqlalchemy.engines [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:48:46.260092 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writer thread running {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:48:46.566050 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: WARNING keystonemiddleware.auth_token [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 12:48:46.573547 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: WARNING keystonemiddleware.auth_token [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 12:48:46.596848 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: WARNING keystonemiddleware.auth_token [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 12:48:46.604181 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: WARNING keystonemiddleware.auth_token [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 12:48:46.917116 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: WARNING keystonemiddleware.auth_token [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 12:48:46.923104 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: WARNING keystonemiddleware.auth_token [None req-0efb92fc-8e57-42f9-b22d-399314d41eef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 12:48:46.929207 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56077d6479c0 pid: 127544 (default app) Oct 03 12:48:46.964869 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: WARNING keystonemiddleware.auth_token [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 12:48:46.970906 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: WARNING keystonemiddleware.auth_token [None req-d6bab589-61f6-46ba-8077-c2d80657cd70 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 12:48:46.976178 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56077d6479c0 pid: 127542 (default app) Oct 03 12:49:24.525959 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=3 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:24.526837 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=3 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:24.528022 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=3 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:24.530174 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=3 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:24.816931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=3 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:24.818501 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=3 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:24.819471 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=3 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:24.820461 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=3 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:25.895505 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-cd9bca4c-fc7e-4615-b066-e9abffb8ef8c tempest-VolumesGetTestJSON-1688838154 tempest-VolumesGetTestJSON-1688838154-project] Action: 'create', calling method: .version_select at 0x7fc7411424c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-863499667", "metadata": {"Type": "work"}}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:49:26.003364 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b9e6ef9a-6fd1-4600-9c23-b37083e5c382 tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Action: 'create', calling method: .version_select at 0x7fc7411414c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-458135282", "metadata": {"Type": "work"}}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b9e6ef9a-6fd1-4600-9c23-b37083e5c382 tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Request method failure captured: Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 121 Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtpUfYP3FZoCFLlZBrscb_P4gxhKXioItYvSN9e-Pk8ohekcIx0axiu5SXDNOlmxVN6OjQQsSAb8fK5OeK0nXxw2Vj9M7-pp1ZrkcuBLAdhOvqvj13GQ2Ot-hvDIgSFfMNUULFlTwRJSzl0ZBzQS0SQ3dv3QJWJ1jQ_yjZtROqlApNY Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 321f40f556444cef9a3bd080792042f5 Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:49:26.010921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:49:26.012902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_321f40f556444cef9a3bd080792042f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/321f40f556444cef9a3bd080792042f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/321f40f556444cef9a3bd080792042f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/321f40f556444cef9a3bd080792042f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:49:26.012902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:26.012902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 321f40f556444cef9a3bd080792042f5 Oct 03 12:49:26.012902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:26.012902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-VolumesNegativeTest-1459467876-project Oct 03 12:49:26.012902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:49:26.012902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:49:26.012902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 82da1ca07d9445bd824e9de45ec6302a Oct 03 12:49:26.012902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-VolumesNegativeTest-1459467876-project Oct 03 12:49:26.012902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Oct 03 12:49:26.012902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-458135282", "metadata": {"Type": "work"}}} Oct 03 12:49:26.012902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: Oct 03 12:49:26.012902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-458135282', 'metadata': {'Type': 'work'}}}} Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise error Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi '#$%' Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:49:26.013879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 12:49:26.015477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 12:49:26.016606 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 12:49:26.016606 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.016606 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b9e6ef9a-6fd1-4600-9c23-b37083e5c382 tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:49:26.016606 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-b9e6ef9a-6fd1-4600-9c23-b37083e5c382 tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.206042 Oct 03 12:49:26.018016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1156 bytes} [Mon Oct 3 12:49:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1213 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 12:49:26.024532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-05faf482-9c61-49c9-90bb-df15d4d4059b tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Action: 'create', calling method: .version_select at 0x7fc741141dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1459984406", "metadata": {"Type": "work"}}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-05faf482-9c61-49c9-90bb-df15d4d4059b tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Request method failure captured: Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 120 Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtpUfYP3FZoCFLlZBrscb_P4gxhKXioItYvSN9e-Pk8ohekcIx0axiu5SXDNOlmxVN6OjQQsSAb8fK5OeK0nXxw2Vj9M7-pp1ZrkcuBLAdhOvqvj13GQ2Ot-hvDIgSFfMNUULFlTwRJSzl0ZBzQS0SQ3dv3QJWJ1jQ_yjZtROqlApNY Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 321f40f556444cef9a3bd080792042f5 Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:49:26.029271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:49:26.030888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_321f40f556444cef9a3bd080792042f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/321f40f556444cef9a3bd080792042f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/321f40f556444cef9a3bd080792042f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/321f40f556444cef9a3bd080792042f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:49:26.030888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:26.030888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 321f40f556444cef9a3bd080792042f5 Oct 03 12:49:26.030888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:26.030888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-VolumesNegativeTest-1459467876-project Oct 03 12:49:26.030888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:49:26.030888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:49:26.030888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 82da1ca07d9445bd824e9de45ec6302a Oct 03 12:49:26.030888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-VolumesNegativeTest-1459467876-project Oct 03 12:49:26.030888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Oct 03 12:49:26.030888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1459984406", "metadata": {"Type": "work"}}} Oct 03 12:49:26.030888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: Oct 03 12:49:26.030888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1459984406', 'metadata': {'Type': 'work'}}}} Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise error Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi '0' Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:49:26.031849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 12:49:26.033923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 12:49:26.035572 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 12:49:26.035572 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.036710 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-05faf482-9c61-49c9-90bb-df15d4d4059b tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:49:26.037723 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-05faf482-9c61-49c9-90bb-df15d4d4059b tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017933 Oct 03 12:49:26.038457 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 2/2] 10.222.0.33 () {60 vars in 1156 bytes} [Mon Oct 3 12:49:26 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 12:49:26.049502 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-37ab98c7-d5f5-4e1b-a86e-5155d0b1dd08 tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Action: 'create', calling method: .version_select at 0x7fc740ffc1f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-615778894", "metadata": {"Type": "work"}}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-37ab98c7-d5f5-4e1b-a86e-5155d0b1dd08 tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Request method failure captured: Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 118 Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtpUfYP3FZoCFLlZBrscb_P4gxhKXioItYvSN9e-Pk8ohekcIx0axiu5SXDNOlmxVN6OjQQsSAb8fK5OeK0nXxw2Vj9M7-pp1ZrkcuBLAdhOvqvj13GQ2Ot-hvDIgSFfMNUULFlTwRJSzl0ZBzQS0SQ3dv3QJWJ1jQ_yjZtROqlApNY Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 321f40f556444cef9a3bd080792042f5 Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:49:26.054003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:49:26.056185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_321f40f556444cef9a3bd080792042f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/321f40f556444cef9a3bd080792042f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/321f40f556444cef9a3bd080792042f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/321f40f556444cef9a3bd080792042f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:49:26.056185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:26.056185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 321f40f556444cef9a3bd080792042f5 Oct 03 12:49:26.056185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:26.056185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-VolumesNegativeTest-1459467876-project Oct 03 12:49:26.056185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:49:26.056185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:49:26.056185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 82da1ca07d9445bd824e9de45ec6302a Oct 03 12:49:26.056185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-VolumesNegativeTest-1459467876-project Oct 03 12:49:26.056185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Oct 03 12:49:26.056185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-615778894", "metadata": {"Type": "work"}}} Oct 03 12:49:26.056185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: Oct 03 12:49:26.056185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-615778894', 'metadata': {'Type': 'work'}}}} Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise error Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi '' Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:49:26.057127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 12:49:26.058400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 12:49:26.066410 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 12:49:26.066410 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:26.066410 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-37ab98c7-d5f5-4e1b-a86e-5155d0b1dd08 tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:49:26.066410 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-37ab98c7-d5f5-4e1b-a86e-5155d0b1dd08 tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016354 Oct 03 12:49:26.067578 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 3/3] 10.222.0.33 () {60 vars in 1156 bytes} [Mon Oct 3 12:49:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 12:49:26.074344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ffe35727-0ccd-4b97-8d04-49dc602d8d6b tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Calling method '.version_select at 0x7fc740ffcca0>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:27.309154 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-ffe35727-0ccd-4b97-8d04-49dc602d8d6b tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] HTTP exception thrown: Volume tempest-invalid-1189804456 could not be found. Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ffe35727-0ccd-4b97-8d04-49dc602d8d6b tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Request method failure captured: Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1189804456 HTTP/1.1 Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtpUfYP3FZoCFLlZBrscb_P4gxhKXioItYvSN9e-Pk8ohekcIx0axiu5SXDNOlmxVN6OjQQsSAb8fK5OeK0nXxw2Vj9M7-pp1ZrkcuBLAdhOvqvj13GQ2Ot-hvDIgSFfMNUULFlTwRJSzl0ZBzQS0SQ3dv3QJWJ1jQ_yjZtROqlApNY Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 321f40f556444cef9a3bd080792042f5 Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:49:27.313141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:49:27.314267 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_321f40f556444cef9a3bd080792042f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/321f40f556444cef9a3bd080792042f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/321f40f556444cef9a3bd080792042f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/321f40f556444cef9a3bd080792042f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:49:27.314267 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:27.314267 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 321f40f556444cef9a3bd080792042f5 Oct 03 12:49:27.314267 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:27.314267 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-VolumesNegativeTest-1459467876-project Oct 03 12:49:27.314267 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:49:27.314267 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:49:27.314267 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 82da1ca07d9445bd824e9de45ec6302a Oct 03 12:49:27.314267 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-VolumesNegativeTest-1459467876-project Oct 03 12:49:27.314267 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: Oct 03 12:49:27.314267 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Volume tempest-invalid-1189804456 could not be found. Oct 03 12:49:27.314267 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': 'tempest-invalid-1189804456'} Oct 03 12:49:27.314267 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1189804456 could not be found. (HTTP 404) (Request-ID: req-fc9f8bdc-9a9f-448c-9452-cd375a86ae0f) Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:27.314921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 12:49:27.320206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1189804456 could not be found. Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:49:27.321053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1189804456 could not be found. Oct 03 12:49:27.321969 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:27.321969 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:27.321969 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:27.321969 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:27.321969 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:49:27.321969 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:49:27.321969 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:49:27.321969 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:49:27.321969 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1189804456 could not be found. Oct 03 12:49:27.321969 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:27.321969 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ffe35727-0ccd-4b97-8d04-49dc602d8d6b tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Returning 404 to user: Volume tempest-invalid-1189804456 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:49:27.321969 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-ffe35727-0ccd-4b97-8d04-49dc602d8d6b tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1189804456" status: 404 len: 99 microversion: 2.1 time: 1.248812 Oct 03 12:49:27.323126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 4/4] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Oct 3 12:49:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1189804456 => generated 99 bytes in 1255 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 12:49:27.331476 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-22ee37be-936a-457d-9fc9-6c183ed0ac4c tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004324 Oct 03 12:49:27.332257 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 5/5] 10.222.0.33 () {58 vars in 1140 bytes} [Mon Oct 3 12:49:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 03 12:49:27.349102 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-709701a5-f321-4111-b7fb-5f0d96cd7a76 tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009819 Oct 03 12:49:27.353976 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 6/6] 10.222.0.33 () {58 vars in 1137 bytes} [Mon Oct 3 12:49:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 03 12:49:27.367779 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1f7b1b39-bfdc-4fc9-9a3d-3e62fb2bedbc tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Calling method '.version_select at 0x7fc740f323a0>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:27.639127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-1f7b1b39-bfdc-4fc9-9a3d-3e62fb2bedbc tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] HTTP exception thrown: Volume a3cb74d4-df26-4897-b0ea-c17aa66a1911 could not be found. Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1f7b1b39-bfdc-4fc9-9a3d-3e62fb2bedbc tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Request method failure captured: Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: DELETE /compute/v2.1/os-volumes/a3cb74d4-df26-4897-b0ea-c17aa66a1911 HTTP/1.1 Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtpUfYP3FZoCFLlZBrscb_P4gxhKXioItYvSN9e-Pk8ohekcIx0axiu5SXDNOlmxVN6OjQQsSAb8fK5OeK0nXxw2Vj9M7-pp1ZrkcuBLAdhOvqvj13GQ2Ot-hvDIgSFfMNUULFlTwRJSzl0ZBzQS0SQ3dv3QJWJ1jQ_yjZtROqlApNY Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 321f40f556444cef9a3bd080792042f5 Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:49:27.644343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:49:27.645381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_321f40f556444cef9a3bd080792042f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/321f40f556444cef9a3bd080792042f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/321f40f556444cef9a3bd080792042f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/321f40f556444cef9a3bd080792042f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:49:27.645381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:27.645381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 321f40f556444cef9a3bd080792042f5 Oct 03 12:49:27.645381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:27.645381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-VolumesNegativeTest-1459467876-project Oct 03 12:49:27.645381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:49:27.645381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:49:27.645381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 82da1ca07d9445bd824e9de45ec6302a Oct 03 12:49:27.645381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-VolumesNegativeTest-1459467876-project Oct 03 12:49:27.645381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: Oct 03 12:49:27.645381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Volume a3cb74d4-df26-4897-b0ea-c17aa66a1911 could not be found. Oct 03 12:49:27.645381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': 'a3cb74d4-df26-4897-b0ea-c17aa66a1911'} Oct 03 12:49:27.645381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a3cb74d4-df26-4897-b0ea-c17aa66a1911 could not be found. (HTTP 404) (Request-ID: req-8e9fda81-a4bd-4ee6-a468-5cc68b103f27) Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:27.645964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 12:49:27.646833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a3cb74d4-df26-4897-b0ea-c17aa66a1911 could not be found. Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 12:49:27.647898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:49:27.649038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a3cb74d4-df26-4897-b0ea-c17aa66a1911 could not be found. Oct 03 12:49:27.649038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:27.649038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:27.649038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:27.649038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:27.649038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:49:27.649038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:49:27.649038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:49:27.649038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:49:27.649038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a3cb74d4-df26-4897-b0ea-c17aa66a1911 could not be found. Oct 03 12:49:27.649038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:27.649038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1f7b1b39-bfdc-4fc9-9a3d-3e62fb2bedbc tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Returning 404 to user: Volume a3cb74d4-df26-4897-b0ea-c17aa66a1911 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:49:27.649038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-1f7b1b39-bfdc-4fc9-9a3d-3e62fb2bedbc tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/a3cb74d4-df26-4897-b0ea-c17aa66a1911" status: 404 len: 109 microversion: 2.1 time: 0.290909 Oct 03 12:49:27.649038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 7/7] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 12:49:27 2022] DELETE /compute/v2.1/os-volumes/a3cb74d4-df26-4897-b0ea-c17aa66a1911 => generated 109 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:49:27.656550 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-cbbb63f5-ea75-46dc-857d-99524771038a tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] Calling method '.version_select at 0x7fc740f32280>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:27.963815 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-cbbb63f5-ea75-46dc-857d-99524771038a tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c8162818-41c6-4bcf-9eea-d8aaf7e543db" status: 200 len: 350 microversion: 2.1 time: 0.311082 Oct 03 12:49:27.977011 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 8/8] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 12:49:27 2022] GET /compute/v2.1/os-volumes/c8162818-41c6-4bcf-9eea-d8aaf7e543db => generated 350 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:49:27.989649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-309f1a6a-0c52-41af-b298-2fb04c48eac8 tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Calling method '.version_select at 0x7fc740f329d0>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:28.035617 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-cd9bca4c-fc7e-4615-b066-e9abffb8ef8c tempest-VolumesGetTestJSON-1688838154 tempest-VolumesGetTestJSON-1688838154-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.528911 Oct 03 12:49:28.037648 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 1/9] 10.222.0.33 () {60 vars in 1156 bytes} [Mon Oct 3 12:49:24 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3533 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 03 12:49:28.055357 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-6350c6ff-3b1b-4c72-afb6-21bf0b555bb9 tempest-VolumesGetTestJSON-1688838154 tempest-VolumesGetTestJSON-1688838154-project] Calling method '.version_select at 0x7fc7410163a0>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:28.804140 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-309f1a6a-0c52-41af-b298-2fb04c48eac8 tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] HTTP exception thrown: Volume a8f2c5b1-eab8-4751-b6a1-365f46abfc49 could not be found. Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-309f1a6a-0c52-41af-b298-2fb04c48eac8 tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Request method failure captured: Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/os-volumes/a8f2c5b1-eab8-4751-b6a1-365f46abfc49 HTTP/1.1 Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtpUfYP3FZoCFLlZBrscb_P4gxhKXioItYvSN9e-Pk8ohekcIx0axiu5SXDNOlmxVN6OjQQsSAb8fK5OeK0nXxw2Vj9M7-pp1ZrkcuBLAdhOvqvj13GQ2Ot-hvDIgSFfMNUULFlTwRJSzl0ZBzQS0SQ3dv3QJWJ1jQ_yjZtROqlApNY Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 321f40f556444cef9a3bd080792042f5 Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:49:28.807736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:49:28.809046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_321f40f556444cef9a3bd080792042f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/321f40f556444cef9a3bd080792042f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/321f40f556444cef9a3bd080792042f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/321f40f556444cef9a3bd080792042f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:49:28.809046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:28.809046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 321f40f556444cef9a3bd080792042f5 Oct 03 12:49:28.809046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-VolumesNegativeTest-1459467876 Oct 03 12:49:28.809046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-VolumesNegativeTest-1459467876-project Oct 03 12:49:28.809046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:49:28.809046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:49:28.809046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 82da1ca07d9445bd824e9de45ec6302a Oct 03 12:49:28.809046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-VolumesNegativeTest-1459467876-project Oct 03 12:49:28.809046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: Oct 03 12:49:28.809046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Volume a8f2c5b1-eab8-4751-b6a1-365f46abfc49 could not be found. Oct 03 12:49:28.809046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': 'a8f2c5b1-eab8-4751-b6a1-365f46abfc49'} Oct 03 12:49:28.809046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a8f2c5b1-eab8-4751-b6a1-365f46abfc49 could not be found. (HTTP 404) (Request-ID: req-0b6ddab3-75dd-4f5f-97ee-f73e13bb1fce) Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:28.809840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 12:49:28.811019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a8f2c5b1-eab8-4751-b6a1-365f46abfc49 could not be found. Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 12:49:28.812717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:49:28.813847 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a8f2c5b1-eab8-4751-b6a1-365f46abfc49 could not be found. Oct 03 12:49:28.813847 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:28.813847 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:28.813847 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:28.813847 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:28.813847 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:49:28.813847 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:49:28.813847 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:49:28.813847 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:49:28.813847 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a8f2c5b1-eab8-4751-b6a1-365f46abfc49 could not be found. Oct 03 12:49:28.813847 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:49:28.817741 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-309f1a6a-0c52-41af-b298-2fb04c48eac8 tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] Returning 404 to user: Volume a8f2c5b1-eab8-4751-b6a1-365f46abfc49 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:49:28.818820 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-309f1a6a-0c52-41af-b298-2fb04c48eac8 tempest-VolumesNegativeTest-1459467876 tempest-VolumesNegativeTest-1459467876-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a8f2c5b1-eab8-4751-b6a1-365f46abfc49" status: 404 len: 109 microversion: 2.1 time: 0.840548 Oct 03 12:49:28.819590 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 9/10] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 12:49:27 2022] GET /compute/v2.1/os-volumes/a8f2c5b1-eab8-4751-b6a1-365f46abfc49 => generated 109 bytes in 842 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:49:28.912837 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-6350c6ff-3b1b-4c72-afb6-21bf0b555bb9 tempest-VolumesGetTestJSON-1688838154 tempest-VolumesGetTestJSON-1688838154-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/038c7b59-1f11-4d48-b2c1-5d66b67e5f86" status: 200 len: 352 microversion: 2.1 time: 0.862914 Oct 03 12:49:28.915723 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 2/11] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 12:49:28 2022] GET /compute/v2.1/os-volumes/038c7b59-1f11-4d48-b2c1-5d66b67e5f86 => generated 352 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:49:29.935709 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4d0397dd-44f4-4829-b563-4ee9f9702c14 tempest-VolumesGetTestJSON-1688838154 tempest-VolumesGetTestJSON-1688838154-project] Calling method '.version_select at 0x7fc740f32d30>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:29.995819 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-4d0397dd-44f4-4829-b563-4ee9f9702c14 tempest-VolumesGetTestJSON-1688838154 tempest-VolumesGetTestJSON-1688838154-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/038c7b59-1f11-4d48-b2c1-5d66b67e5f86" status: 200 len: 353 microversion: 2.1 time: 0.071718 Oct 03 12:49:29.996947 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 10/12] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 12:49:29 2022] GET /compute/v2.1/os-volumes/038c7b59-1f11-4d48-b2c1-5d66b67e5f86 => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:49:30.013291 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e08a4320-89df-4f6e-b9be-8d499631b9c6 tempest-VolumesGetTestJSON-1688838154 tempest-VolumesGetTestJSON-1688838154-project] Calling method '.version_select at 0x7fc741016a60>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:30.265783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e08a4320-89df-4f6e-b9be-8d499631b9c6 tempest-VolumesGetTestJSON-1688838154 tempest-VolumesGetTestJSON-1688838154-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/038c7b59-1f11-4d48-b2c1-5d66b67e5f86" status: 200 len: 353 microversion: 2.1 time: 0.258578 Oct 03 12:49:30.281389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 3/13] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 12:49:30 2022] GET /compute/v2.1/os-volumes/038c7b59-1f11-4d48-b2c1-5d66b67e5f86 => generated 353 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:49:30.293962 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-97814485-0faa-456d-94dd-f0fd6df13cd9 tempest-VolumesGetTestJSON-1688838154 tempest-VolumesGetTestJSON-1688838154-project] Calling method '.version_select at 0x7fc740f320d0>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:30.416356 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-4fc99f2e-42fb-49d0-bd31-36e5ccb660cd tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] Calling method '.version_select at 0x7fc740fae160>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:30.664734 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-97814485-0faa-456d-94dd-f0fd6df13cd9 tempest-VolumesGetTestJSON-1688838154 tempest-VolumesGetTestJSON-1688838154-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/038c7b59-1f11-4d48-b2c1-5d66b67e5f86" status: 202 len: 0 microversion: 2.1 time: 0.374498 Oct 03 12:49:30.669130 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 11/14] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 12:49:30 2022] DELETE /compute/v2.1/os-volumes/038c7b59-1f11-4d48-b2c1-5d66b67e5f86 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:49:30.677787 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ddd3abf0-03d1-413e-8bf1-e1277d448c2c tempest-VolumesGetTestJSON-1688838154 tempest-VolumesGetTestJSON-1688838154-project] Calling method '.version_select at 0x7fc740f36040>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:30.796702 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-4fc99f2e-42fb-49d0-bd31-36e5ccb660cd tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fe7e7ff5-1e95-4251-af83-b3249f82c95d" status: 200 len: 350 microversion: 2.1 time: 0.385712 Oct 03 12:49:30.799973 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 4/15] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 12:49:30 2022] GET /compute/v2.1/os-volumes/fe7e7ff5-1e95-4251-af83-b3249f82c95d => generated 350 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:49:30.880567 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-ddd3abf0-03d1-413e-8bf1-e1277d448c2c tempest-VolumesGetTestJSON-1688838154 tempest-VolumesGetTestJSON-1688838154-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/038c7b59-1f11-4d48-b2c1-5d66b67e5f86" status: 200 len: 352 microversion: 2.1 time: 0.209872 Oct 03 12:49:30.882050 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 12/16] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 12:49:30 2022] GET /compute/v2.1/os-volumes/038c7b59-1f11-4d48-b2c1-5d66b67e5f86 => generated 352 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:49:31.902588 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bad60eba-049d-4919-af89-f754b8ba2a87 tempest-VolumesGetTestJSON-1688838154 tempest-VolumesGetTestJSON-1688838154-project] Calling method '.version_select at 0x7fc741016ca0>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:31.951891 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-bad60eba-049d-4919-af89-f754b8ba2a87 tempest-VolumesGetTestJSON-1688838154 tempest-VolumesGetTestJSON-1688838154-project] HTTP exception thrown: Volume 038c7b59-1f11-4d48-b2c1-5d66b67e5f86 could not be found. Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bad60eba-049d-4919-af89-f754b8ba2a87 tempest-VolumesGetTestJSON-1688838154 tempest-VolumesGetTestJSON-1688838154-project] Request method failure captured: Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: GET /compute/v2.1/os-volumes/038c7b59-1f11-4d48-b2c1-5d66b67e5f86 HTTP/1.1 Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtpUraQqLre-N_kNisYYMOiU6lFGIY41m9TNUiBvxBn8p4aotbgvtD1VGOUwRh7qgKpWMrO9ta8B4hr4kqlUQuiDhUvqZ8X1ggMfwd4S6zIxvFPB-V-c6ETGNw4mkRsessEOn0AidjtUu_3YOwqLPDtObJwZKYTA4FbfDzzI_qohwbQ Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: 95c05358d0df40c5971e3822352eb8b9 Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-VolumesGetTestJSON-1688838154 Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 12:49:31.960035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 12:49:31.961208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_95c05358d0df40c5971e3822352eb8b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/95c05358d0df40c5971e3822352eb8b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/95c05358d0df40c5971e3822352eb8b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/95c05358d0df40c5971e3822352eb8b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:49:31.961208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-VolumesGetTestJSON-1688838154 Oct 03 12:49:31.961208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: 95c05358d0df40c5971e3822352eb8b9 Oct 03 12:49:31.961208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-VolumesGetTestJSON-1688838154 Oct 03 12:49:31.961208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-VolumesGetTestJSON-1688838154-project Oct 03 12:49:31.961208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 12:49:31.961208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 12:49:31.961208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: 3d49169ba293429da881db9296301f32 Oct 03 12:49:31.961208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-VolumesGetTestJSON-1688838154-project Oct 03 12:49:31.961208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: Oct 03 12:49:31.961208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Volume 038c7b59-1f11-4d48-b2c1-5d66b67e5f86 could not be found. Oct 03 12:49:31.961208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': '038c7b59-1f11-4d48-b2c1-5d66b67e5f86'} Oct 03 12:49:31.961208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 038c7b59-1f11-4d48-b2c1-5d66b67e5f86 could not be found. (HTTP 404) (Request-ID: req-10befc3d-35db-4161-8c21-a92d6929506c) Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:31.962131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 12:49:31.963095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 038c7b59-1f11-4d48-b2c1-5d66b67e5f86 could not be found. Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 12:49:31.964503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:49:31.966763 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 038c7b59-1f11-4d48-b2c1-5d66b67e5f86 could not be found. Oct 03 12:49:31.966763 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:49:31.966763 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:49:31.966763 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:49:31.966763 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:49:31.966763 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:49:31.966763 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:49:31.966763 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:49:31.966763 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:49:31.966763 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 038c7b59-1f11-4d48-b2c1-5d66b67e5f86 could not be found. Oct 03 12:49:31.966763 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:49:31.977758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bad60eba-049d-4919-af89-f754b8ba2a87 tempest-VolumesGetTestJSON-1688838154 tempest-VolumesGetTestJSON-1688838154-project] Returning 404 to user: Volume 038c7b59-1f11-4d48-b2c1-5d66b67e5f86 could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:49:31.981266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-bad60eba-049d-4919-af89-f754b8ba2a87 tempest-VolumesGetTestJSON-1688838154 tempest-VolumesGetTestJSON-1688838154-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/038c7b59-1f11-4d48-b2c1-5d66b67e5f86" status: 404 len: 109 microversion: 2.1 time: 0.085131 Oct 03 12:49:31.984982 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 5/17] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 12:49:31 2022] GET /compute/v2.1/os-volumes/038c7b59-1f11-4d48-b2c1-5d66b67e5f86 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:49:33.123781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e36810bd-b015-47a6-b2d8-5f2280353a31 tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] Calling method '.version_select at 0x7fc740f32700>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:33.244114 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e36810bd-b015-47a6-b2d8-5f2280353a31 tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/22a03ac4-027f-4020-adb1-8a32395ec498" status: 200 len: 351 microversion: 2.1 time: 0.124300 Oct 03 12:49:33.257651 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 13/18] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 12:49:33 2022] GET /compute/v2.1/os-volumes/22a03ac4-027f-4020-adb1-8a32395ec498 => generated 351 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:49:33.261943 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bb7def18-56f9-480e-a14f-84bd0b1ba37f tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] Calling method '.version_select at 0x7fc74196fb80>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:33.514156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-bb7def18-56f9-480e-a14f-84bd0b1ba37f tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.259300 Oct 03 12:49:33.515750 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 6/19] 10.222.0.33 () {58 vars in 1134 bytes} [Mon Oct 3 12:49:33 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:33.531653 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-051cd99d-4fc2-4332-b7ce-f995f2c3edcf tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] Calling method '.version_select at 0x7fc740f80b80>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:33.783595 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-051cd99d-4fc2-4332-b7ce-f995f2c3edcf tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.255820 Oct 03 12:49:33.796805 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 14/20] 10.222.0.33 () {58 vars in 1149 bytes} [Mon Oct 3 12:49:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:49:33.801361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ca99d78f-f8e9-407b-8c95-ba19fd6bcd0f tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] Calling method '.version_select at 0x7fc741026700>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:34.002226 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ca99d78f-f8e9-407b-8c95-ba19fd6bcd0f tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.203153 Oct 03 12:49:34.003985 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 7/21] 10.222.0.33 () {58 vars in 1134 bytes} [Mon Oct 3 12:49:33 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:34.021307 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ebb439c6-c91f-491a-a958-39e152302059 tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] Calling method '.version_select at 0x7fc740f36430>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:34.228882 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-ebb439c6-c91f-491a-a958-39e152302059 tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.215508 Oct 03 12:49:34.229441 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 15/22] 10.222.0.33 () {58 vars in 1167 bytes} [Mon Oct 3 12:49:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:49:34.246273 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-afc4a25a-ff59-43be-a39d-ba3286000dec tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] Calling method '.version_select at 0x7fc741024a60>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:34.452624 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-afc4a25a-ff59-43be-a39d-ba3286000dec tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.212399 Oct 03 12:49:34.453185 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 8/23] 10.222.0.33 () {58 vars in 1170 bytes} [Mon Oct 3 12:49:34 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:49:34.468965 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4fc5d15c-8780-4ef2-8a9f-46be20bde6d1 tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] Calling method '.version_select at 0x7fc740f36820>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:34.633583 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-4fc5d15c-8780-4ef2-8a9f-46be20bde6d1 tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.168076 Oct 03 12:49:34.633583 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 16/24] 10.222.0.33 () {58 vars in 1155 bytes} [Mon Oct 3 12:49:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:34.646608 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-7090e9ac-5f7f-47b5-a757-d289f5ea7012 tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] Calling method '.version_select at 0x7fc741024790>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:34.807873 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-7090e9ac-5f7f-47b5-a757-d289f5ea7012 tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.165606 Oct 03 12:49:34.809715 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 9/25] 10.222.0.33 () {58 vars in 1188 bytes} [Mon Oct 3 12:49:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:49:34.833241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3b1213c3-d374-4b73-a8c2-7d136e4eeac5 tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] Calling method '.version_select at 0x7fc740f80af0>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:34.993082 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3b1213c3-d374-4b73-a8c2-7d136e4eeac5 tempest-VolumesTestJSON-44629916 tempest-VolumesTestJSON-44629916-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.164645 Oct 03 12:49:35.014537 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 17/26] 10.222.0.33 () {58 vars in 1155 bytes} [Mon Oct 3 12:49:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:37.390194 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-436704122", "imageRef": "9d585789-e496-433d-b311-70ec7ceffd99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:49:37.646812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.network.neutron [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] validate_networks() for [('f492b9a3-221f-4263-a074-289d6252f405', None, None, None, None, None)] {{(pid=127544) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:49:39.086442 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1087508521", "imageRef": "9d585789-e496-433d-b311-70ec7ceffd99", "flavorRef": "452", "networks": [{"uuid": "60e0722d-40b6-482b-9c0e-b5673c4a039a"}]}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:49:39.354659 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Flavor limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:49:39.355150 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Image limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:49:39.355605 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Flavor pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:49:39.356024 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Image pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:49:39.356450 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:49:39.374991 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.network.neutron [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] validate_networks() for [('60e0722d-40b6-482b-9c0e-b5673c4a039a', None, None, None, None, None)] {{(pid=127542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:49:39.401519 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:39.402019 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:39.402482 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:39.403221 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:39.403711 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:39.404141 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:39.497641 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Getting quotas for project 3f2b18d217d14d39886718cf209eb576. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:49:39.514542 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Getting quotas for user ad5654cfa65f4cfa9e68832b9cd3d129 and project 3f2b18d217d14d39886718cf209eb576. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:49:39.532271 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Going to run 1 instances... {{(pid=127544) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:49:39.535767 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d585789-e496-433d-b311-70ec7ceffd99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:49:39.840220 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-300cf19c-aace-4b43-9c45-533a4301c40c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.923710 Oct 03 12:49:39.849918 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 10/27] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:49:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:49:39.869020 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-5b34ed55-00e0-44af-bc8e-2240676b61ce tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:39.869806 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-5b34ed55-00e0-44af-bc8e-2240676b61ce tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:40.053490 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5b34ed55-00e0-44af-bc8e-2240676b61ce tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:40.080767 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-5b34ed55-00e0-44af-bc8e-2240676b61ce tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1221 microversion: 2.1 time: 0.230582 Oct 03 12:49:40.083970 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 11/28] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:39 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1221 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:40.394147 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-128436330", "imageRef": "9d585789-e496-433d-b311-70ec7ceffd99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:49:40.522669 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.network.neutron [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] validate_networks() for [('f492b9a3-221f-4263-a074-289d6252f405', None, None, None, None, None)] {{(pid=127544) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:49:41.335428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Flavor limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:49:41.335971 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Image limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:49:41.336349 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Flavor pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:49:41.336765 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Image pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:49:41.337172 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:49:41.401788 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:41.403730 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:41.404953 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:41.407602 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:41.409526 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:41.410236 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:41.524556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Getting quotas for project d7994e24004a42ac88491cf70b3d1086. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:49:41.542452 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Getting quotas for user f938505064304ae19cd0a6df370b7721 and project d7994e24004a42ac88491cf70b3d1086. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:49:41.581939 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Going to run 1 instances... {{(pid=127542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:49:41.593058 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d585789-e496-433d-b311-70ec7ceffd99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:49:41.795663 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Flavor limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:49:41.796152 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Image limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:49:41.796557 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Flavor pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:49:41.796973 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Image pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:49:41.797392 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:49:41.828238 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:41.833889 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:41.839967 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:41.839967 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:41.839967 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:41.839967 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:41.966850 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Getting quotas for project 3f2b18d217d14d39886718cf209eb576. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:49:41.975044 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f67ab28c-1638-4028-8138-1584679658cf tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.113822 Oct 03 12:49:41.980378 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 18/29] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:49:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:49:41.988931 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Getting quotas for user ad5654cfa65f4cfa9e68832b9cd3d129 and project 3f2b18d217d14d39886718cf209eb576. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:49:42.010528 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-5f9a4402-2005-4f80-9a65-9ec810e97694 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:42.011173 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-5f9a4402-2005-4f80-9a65-9ec810e97694 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:42.063462 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Going to run 1 instances... {{(pid=127544) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:49:42.076339 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d585789-e496-433d-b311-70ec7ceffd99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:49:42.255902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-5f9a4402-2005-4f80-9a65-9ec810e97694 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:42.289878 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-5f9a4402-2005-4f80-9a65-9ec810e97694 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1215 microversion: 2.1 time: 0.298284 Oct 03 12:49:42.291122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 19/30] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:41 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1215 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:42.351032 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-dcc2d966-f6a1-4649-bac8-5158d55d57fc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.960534 Oct 03 12:49:42.352823 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 12/31] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:49:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 1965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 12:49:42.366805 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d7e4531f-0295-444d-bb33-7a5baf6859df tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:42.367696 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d7e4531f-0295-444d-bb33-7a5baf6859df tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:42.664254 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d7e4531f-0295-444d-bb33-7a5baf6859df tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:42.697050 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d7e4531f-0295-444d-bb33-7a5baf6859df tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1221 microversion: 2.1 time: 0.334841 Oct 03 12:49:42.701658 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 20/32] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:42 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1221 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:43.325378 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-65bc8f6a-3e49-4e91-a8f3-e60da03c2aa6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:43.335463 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-65bc8f6a-3e49-4e91-a8f3-e60da03c2aa6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:43.583998 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-65bc8f6a-3e49-4e91-a8f3-e60da03c2aa6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:43.600896 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-65bc8f6a-3e49-4e91-a8f3-e60da03c2aa6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1215 microversion: 2.1 time: 0.282197 Oct 03 12:49:43.606699 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 13/33] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:43 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1215 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:43.732370 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0c3da919-5692-4e8e-bd5e-d698d64101da tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:43.733277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-0c3da919-5692-4e8e-bd5e-d698d64101da tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:43.894301 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0c3da919-5692-4e8e-bd5e-d698d64101da tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:43.907674 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-0c3da919-5692-4e8e-bd5e-d698d64101da tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1221 microversion: 2.1 time: 0.175847 Oct 03 12:49:43.908597 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 21/34] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:43 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1221 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:44.632184 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-fef54d95-f492-4204-8ea6-996f3c832d5e tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:44.633630 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-fef54d95-f492-4204-8ea6-996f3c832d5e tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:44.825544 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-fef54d95-f492-4204-8ea6-996f3c832d5e tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:44.848708 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-fef54d95-f492-4204-8ea6-996f3c832d5e tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1215 microversion: 2.1 time: 0.218979 Oct 03 12:49:44.849266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 14/35] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:44 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1215 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:49:44.932737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-282e0976-a59a-411d-a71d-31813bf425b1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:44.933288 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-282e0976-a59a-411d-a71d-31813bf425b1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:44.951222 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-282e0976-a59a-411d-a71d-31813bf425b1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:44.953328 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-282e0976-a59a-411d-a71d-31813bf425b1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:44.953936 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-282e0976-a59a-411d-a71d-31813bf425b1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:44.958822 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-282e0976-a59a-411d-a71d-31813bf425b1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:44.962728 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-282e0976-a59a-411d-a71d-31813bf425b1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:44.977710 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-282e0976-a59a-411d-a71d-31813bf425b1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:45.295684 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-282e0976-a59a-411d-a71d-31813bf425b1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:45.328881 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-282e0976-a59a-411d-a71d-31813bf425b1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1217 microversion: 2.1 time: 0.399929 Oct 03 12:49:45.330630 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 22/36] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:44 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1217 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:45.881555 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-6d9c1ed0-5b3f-4c12-85dc-4dc0b9f2b621 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:45.882413 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-6d9c1ed0-5b3f-4c12-85dc-4dc0b9f2b621 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:45.890221 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6d9c1ed0-5b3f-4c12-85dc-4dc0b9f2b621 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:45.890945 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6d9c1ed0-5b3f-4c12-85dc-4dc0b9f2b621 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:45.891957 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6d9c1ed0-5b3f-4c12-85dc-4dc0b9f2b621 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:45.893069 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6d9c1ed0-5b3f-4c12-85dc-4dc0b9f2b621 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:45.895851 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6d9c1ed0-5b3f-4c12-85dc-4dc0b9f2b621 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:45.895851 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6d9c1ed0-5b3f-4c12-85dc-4dc0b9f2b621 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:46.207564 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-6d9c1ed0-5b3f-4c12-85dc-4dc0b9f2b621 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:46.227509 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-6d9c1ed0-5b3f-4c12-85dc-4dc0b9f2b621 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1211 microversion: 2.1 time: 0.356436 Oct 03 12:49:46.228097 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 15/37] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:45 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1211 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:46.374491 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-02761151-dc72-4e5a-945b-751d9489036d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:46.374491 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-02761151-dc72-4e5a-945b-751d9489036d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:46.395653 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02761151-dc72-4e5a-945b-751d9489036d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:46.397767 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02761151-dc72-4e5a-945b-751d9489036d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:46.399131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02761151-dc72-4e5a-945b-751d9489036d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:46.400506 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02761151-dc72-4e5a-945b-751d9489036d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:46.409460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02761151-dc72-4e5a-945b-751d9489036d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:46.409460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02761151-dc72-4e5a-945b-751d9489036d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:46.722082 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-02761151-dc72-4e5a-945b-751d9489036d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:46.737072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-02761151-dc72-4e5a-945b-751d9489036d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1273 microversion: 2.1 time: 0.379189 Oct 03 12:49:46.751349 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 16/38] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:46 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1273 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:49:46.767410 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-47084d3e-c076-4398-91c8-2212b8fd5224 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Action: 'create', calling method: .version_select at 0x7fc740574e50>, body: {"keypair": {"name": "tempest-keypair-1854368905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCHq+2dQLjSkyET1x2W0dt37fCALNd1mUZZr824kJn/cAiw6pmqURNy3cyBDQnqdneYxBbgX6JnRM+oiaHxrtSqdjmPjrHMJGxXvxPawpO87sOc9jgh7PyOeH/+QhIFqA=="}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:49:46.807592 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-47084d3e-c076-4398-91c8-2212b8fd5224 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Getting quotas for project 0e20f793bd0b46a59df730183818d9f8. Resources: {'key_pairs'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:49:46.812917 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-47084d3e-c076-4398-91c8-2212b8fd5224 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Getting quotas for user 676b2a6bbf6e4df1b47dba2a9b8e8862 and project 0e20f793bd0b46a59df730183818d9f8. Resources: {'key_pairs'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:49:46.920706 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-47084d3e-c076-4398-91c8-2212b8fd5224 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.710821 Oct 03 12:49:46.921864 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 23/39] 10.222.0.33 () {62 vars in 1200 bytes} [Mon Oct 3 12:49:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 713 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 03 12:49:47.254976 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e9d1b798-dea4-4531-8b9f-81b029e0d819 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:47.255704 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e9d1b798-dea4-4531-8b9f-81b029e0d819 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:47.279892 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e9d1b798-dea4-4531-8b9f-81b029e0d819 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:47.282357 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e9d1b798-dea4-4531-8b9f-81b029e0d819 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:47.285994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e9d1b798-dea4-4531-8b9f-81b029e0d819 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:47.287759 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e9d1b798-dea4-4531-8b9f-81b029e0d819 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:47.294443 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e9d1b798-dea4-4531-8b9f-81b029e0d819 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:47.295167 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e9d1b798-dea4-4531-8b9f-81b029e0d819 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:47.514968 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e9d1b798-dea4-4531-8b9f-81b029e0d819 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:47.531334 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e9d1b798-dea4-4531-8b9f-81b029e0d819 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1267 microversion: 2.1 time: 0.281391 Oct 03 12:49:47.539635 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 24/40] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:47 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1267 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:47.585404 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-75f6b803-0506-4b84-8758-24ab389b5e51 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Action: 'create', calling method: .version_select at 0x7fc740644dc0>, body: {"keypair": {"name": "tempest-keypair-1409910373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtV5Wz72PNY8XWvlBzf9OA0WD4mDqYEKJdtop36fCWv2dnulHBSMIXqwZoWQnOF56f1AvV1cN0WVjQ0IfO89XIPuo3W+L6kuF6xpS0URWXd/+MWzh4N6bvoLfoFyfhwYA=="}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:49:47.658646 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-75f6b803-0506-4b84-8758-24ab389b5e51 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Getting quotas for project cc40d256f0e24050b6b53fdbcbce1962. Resources: {'key_pairs'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:49:47.671797 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-75f6b803-0506-4b84-8758-24ab389b5e51 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Getting quotas for user bd24d209dc9644e8b2860a0e676acd3b and project cc40d256f0e24050b6b53fdbcbce1962. Resources: {'key_pairs'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:49:47.763581 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e696231a-4c44-4b95-85cd-95b943b0d4c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:47.764592 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e696231a-4c44-4b95-85cd-95b943b0d4c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:47.777209 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e696231a-4c44-4b95-85cd-95b943b0d4c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:47.777854 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e696231a-4c44-4b95-85cd-95b943b0d4c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:47.780349 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e696231a-4c44-4b95-85cd-95b943b0d4c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:47.784193 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e696231a-4c44-4b95-85cd-95b943b0d4c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:47.786276 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e696231a-4c44-4b95-85cd-95b943b0d4c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:47.788643 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e696231a-4c44-4b95-85cd-95b943b0d4c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:47.883791 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-75f6b803-0506-4b84-8758-24ab389b5e51 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.143552 Oct 03 12:49:47.887277 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 17/41] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 12:49:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:49:47.920629 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e696231a-4c44-4b95-85cd-95b943b0d4c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:47.929843 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e696231a-4c44-4b95-85cd-95b943b0d4c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1291 microversion: 2.1 time: 0.172718 Oct 03 12:49:47.933504 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 25/42] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:47 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1291 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:48.571667 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ecbf2ab6-90bb-44ea-9ebd-88d3298eff38 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:48.572688 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ecbf2ab6-90bb-44ea-9ebd-88d3298eff38 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:48.596093 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ecbf2ab6-90bb-44ea-9ebd-88d3298eff38 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:48.599721 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ecbf2ab6-90bb-44ea-9ebd-88d3298eff38 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:48.602461 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ecbf2ab6-90bb-44ea-9ebd-88d3298eff38 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:48.605285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ecbf2ab6-90bb-44ea-9ebd-88d3298eff38 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:48.607596 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ecbf2ab6-90bb-44ea-9ebd-88d3298eff38 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:48.609184 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ecbf2ab6-90bb-44ea-9ebd-88d3298eff38 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:48.948527 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-ecbf2ab6-90bb-44ea-9ebd-88d3298eff38 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:48.957053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ef757bd2-2815-4401-bfb0-b97db59bc39b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:48.957970 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ecbf2ab6-90bb-44ea-9ebd-88d3298eff38 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1275 microversion: 2.1 time: 0.399379 Oct 03 12:49:48.958355 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-ef757bd2-2815-4401-bfb0-b97db59bc39b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:48.959225 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 18/43] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:48 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1275 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:48.979921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ef757bd2-2815-4401-bfb0-b97db59bc39b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:48.980517 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ef757bd2-2815-4401-bfb0-b97db59bc39b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:48.981032 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ef757bd2-2815-4401-bfb0-b97db59bc39b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:48.981812 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ef757bd2-2815-4401-bfb0-b97db59bc39b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:48.982464 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ef757bd2-2815-4401-bfb0-b97db59bc39b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:48.983846 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ef757bd2-2815-4401-bfb0-b97db59bc39b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:49.156048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-ef757bd2-2815-4401-bfb0-b97db59bc39b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:49.166054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-ef757bd2-2815-4401-bfb0-b97db59bc39b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1279 microversion: 2.1 time: 0.212060 Oct 03 12:49:49.166054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 26/44] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:48 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1279 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:49:49.988431 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3737c280-425b-45c8-b8bc-be8f93893a3f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:49.989795 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-3737c280-425b-45c8-b8bc-be8f93893a3f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:50.015612 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3737c280-425b-45c8-b8bc-be8f93893a3f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:50.016351 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3737c280-425b-45c8-b8bc-be8f93893a3f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:50.021038 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3737c280-425b-45c8-b8bc-be8f93893a3f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:50.025211 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3737c280-425b-45c8-b8bc-be8f93893a3f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:50.028026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3737c280-425b-45c8-b8bc-be8f93893a3f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:50.030748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3737c280-425b-45c8-b8bc-be8f93893a3f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:50.189988 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-dd6a6994-2437-469e-8a3c-f9128e6be6a2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:50.191663 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-dd6a6994-2437-469e-8a3c-f9128e6be6a2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:50.204309 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dd6a6994-2437-469e-8a3c-f9128e6be6a2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:50.206196 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dd6a6994-2437-469e-8a3c-f9128e6be6a2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:50.206872 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dd6a6994-2437-469e-8a3c-f9128e6be6a2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:50.212212 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dd6a6994-2437-469e-8a3c-f9128e6be6a2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:50.213003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dd6a6994-2437-469e-8a3c-f9128e6be6a2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:50.213634 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dd6a6994-2437-469e-8a3c-f9128e6be6a2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:50.604182 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3737c280-425b-45c8-b8bc-be8f93893a3f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:50.613200 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-3737c280-425b-45c8-b8bc-be8f93893a3f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1273 microversion: 2.1 time: 0.631351 Oct 03 12:49:50.624567 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-dd6a6994-2437-469e-8a3c-f9128e6be6a2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:50.643613 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 19/45] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:49 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1273 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:50.649611 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-dd6a6994-2437-469e-8a3c-f9128e6be6a2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1279 microversion: 2.1 time: 0.463878 Oct 03 12:49:50.650108 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 27/46] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:50 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1279 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:49:51.660924 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-92073262-8513-4bc0-8678-6f18f9aeded4 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:51.661661 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-92073262-8513-4bc0-8678-6f18f9aeded4 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:51.678966 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d586221d-ecb2-4128-88be-89270a4ac286 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:51.679664 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d586221d-ecb2-4128-88be-89270a4ac286 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:51.682033 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:51.701279 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92073262-8513-4bc0-8678-6f18f9aeded4 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:51.701796 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92073262-8513-4bc0-8678-6f18f9aeded4 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:51.702251 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92073262-8513-4bc0-8678-6f18f9aeded4 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:51.703344 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92073262-8513-4bc0-8678-6f18f9aeded4 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:51.703533 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92073262-8513-4bc0-8678-6f18f9aeded4 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:51.703966 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92073262-8513-4bc0-8678-6f18f9aeded4 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:51.713226 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d586221d-ecb2-4128-88be-89270a4ac286 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:51.713811 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d586221d-ecb2-4128-88be-89270a4ac286 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:51.714292 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d586221d-ecb2-4128-88be-89270a4ac286 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:51.715028 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d586221d-ecb2-4128-88be-89270a4ac286 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:51.741572 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d586221d-ecb2-4128-88be-89270a4ac286 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:51.742163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d586221d-ecb2-4128-88be-89270a4ac286 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:51.908458 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=4 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:52.304840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d586221d-ecb2-4128-88be-89270a4ac286 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:52.315505 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d586221d-ecb2-4128-88be-89270a4ac286 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1279 microversion: 2.1 time: 0.638588 Oct 03 12:49:52.327876 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 28/47] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:51 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1279 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:49:53.343743 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-2ae7b224-167a-4382-99f2-fa788a3af836 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:53.344774 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-2ae7b224-167a-4382-99f2-fa788a3af836 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:53.367750 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2ae7b224-167a-4382-99f2-fa788a3af836 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:53.368508 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2ae7b224-167a-4382-99f2-fa788a3af836 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:53.368983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2ae7b224-167a-4382-99f2-fa788a3af836 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:53.370571 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2ae7b224-167a-4382-99f2-fa788a3af836 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:53.371033 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2ae7b224-167a-4382-99f2-fa788a3af836 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:53.373624 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2ae7b224-167a-4382-99f2-fa788a3af836 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:54.397858 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-92073262-8513-4bc0-8678-6f18f9aeded4 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:54.410095 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-92073262-8513-4bc0-8678-6f18f9aeded4 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 2.753387 Oct 03 12:49:54.411603 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 20/48] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:51 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 2759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:55.087290 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-2ae7b224-167a-4382-99f2-fa788a3af836 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:55.122864 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-2ae7b224-167a-4382-99f2-fa788a3af836 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 1.782285 Oct 03 12:49:55.124415 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 29/49] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:53 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:55.443210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b8b78fe3-a0bb-442b-81d6-330388203e15 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:55.445368 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-b8b78fe3-a0bb-442b-81d6-330388203e15 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:55.480517 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b8b78fe3-a0bb-442b-81d6-330388203e15 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:55.481105 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b8b78fe3-a0bb-442b-81d6-330388203e15 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:55.481720 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b8b78fe3-a0bb-442b-81d6-330388203e15 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:55.482506 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b8b78fe3-a0bb-442b-81d6-330388203e15 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:55.482983 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b8b78fe3-a0bb-442b-81d6-330388203e15 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:55.483691 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b8b78fe3-a0bb-442b-81d6-330388203e15 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:56.149525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-5303d46b-d786-4885-a3d6-fb87346c5ccd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:56.150151 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-5303d46b-d786-4885-a3d6-fb87346c5ccd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:56.159202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5303d46b-d786-4885-a3d6-fb87346c5ccd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:56.161818 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5303d46b-d786-4885-a3d6-fb87346c5ccd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:56.162959 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5303d46b-d786-4885-a3d6-fb87346c5ccd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:56.164879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5303d46b-d786-4885-a3d6-fb87346c5ccd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:56.165370 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5303d46b-d786-4885-a3d6-fb87346c5ccd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:56.165812 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5303d46b-d786-4885-a3d6-fb87346c5ccd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:56.825441 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=16 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:57.697069 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-b8b78fe3-a0bb-442b-81d6-330388203e15 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:57.703453 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=22 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:57.707570 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-b8b78fe3-a0bb-442b-81d6-330388203e15 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 2.269046 Oct 03 12:49:57.716538 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 21/50] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:55 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 2279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:58.476159 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-5303d46b-d786-4885-a3d6-fb87346c5ccd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:58.502741 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-5303d46b-d786-4885-a3d6-fb87346c5ccd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 2.354690 Oct 03 12:49:58.508514 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 30/51] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:56 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 2363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:49:58.540616 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-f4e25f2b-a0dd-49ed-b77a-71a97a3746b4 req-0df2deef-7498-4fac-ab21-137daddd1313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9909a9d-feb5-4513-9e14-6aadc4e17c59", "tag": "ca96c603-3295-4d37-99aa-2b5b95419166"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:49:58.599973 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-f4e25f2b-a0dd-49ed-b77a-71a97a3746b4 req-0df2deef-7498-4fac-ab21-137daddd1313 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:58.600830 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-f4e25f2b-a0dd-49ed-b77a-71a97a3746b4 req-0df2deef-7498-4fac-ab21-137daddd1313 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:58.602610 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-f4e25f2b-a0dd-49ed-b77a-71a97a3746b4 req-0df2deef-7498-4fac-ab21-137daddd1313 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:58.712808 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-f4e25f2b-a0dd-49ed-b77a-71a97a3746b4 req-0df2deef-7498-4fac-ab21-137daddd1313 service nova] Creating event network-changed:ca96c603-3295-4d37-99aa-2b5b95419166 for instance f9909a9d-feb5-4513-9e14-6aadc4e17c59 on hv-cinder-84456 Oct 03 12:49:58.715329 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-f4e25f2b-a0dd-49ed-b77a-71a97a3746b4 req-0df2deef-7498-4fac-ab21-137daddd1313 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 12:49:58.717429 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-f4e25f2b-a0dd-49ed-b77a-71a97a3746b4 req-0df2deef-7498-4fac-ab21-137daddd1313 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 12:49:58.722138 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-22ef3ce5-4a3f-48f4-a817-1fcb96d3f79f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:58.723094 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-22ef3ce5-4a3f-48f4-a817-1fcb96d3f79f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:58.728210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-22ef3ce5-4a3f-48f4-a817-1fcb96d3f79f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:58.728210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-22ef3ce5-4a3f-48f4-a817-1fcb96d3f79f None None] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:58.728210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-22ef3ce5-4a3f-48f4-a817-1fcb96d3f79f None None] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:58.728210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-22ef3ce5-4a3f-48f4-a817-1fcb96d3f79f None None] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:58.737761 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-aff629eb-1486-4861-935b-eae70d9e37ce tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:58.739913 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-aff629eb-1486-4861-935b-eae70d9e37ce tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:58.753684 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.compute.rpcapi [None req-22ef3ce5-4a3f-48f4-a817-1fcb96d3f79f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 03 12:49:58.756838 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-22ef3ce5-4a3f-48f4-a817-1fcb96d3f79f None None] Releasing lock "compute-rpcapi-router" {{(pid=127544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 12:49:58.790718 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-22ef3ce5-4a3f-48f4-a817-1fcb96d3f79f None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.556162 Oct 03 12:49:58.791492 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aff629eb-1486-4861-935b-eae70d9e37ce tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:58.794220 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 22/52] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:49:58.797356 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aff629eb-1486-4861-935b-eae70d9e37ce tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:58.797825 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aff629eb-1486-4861-935b-eae70d9e37ce tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:58.798778 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aff629eb-1486-4861-935b-eae70d9e37ce tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:58.799395 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aff629eb-1486-4861-935b-eae70d9e37ce tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:58.799705 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aff629eb-1486-4861-935b-eae70d9e37ce tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:59.032956 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-4be4379c-7357-4178-a1b4-3a2779f7ea11 req-070d2178-d67a-4d7f-8c19-3b538afd13c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89c20240-a307-4c2f-8121-6150803fef0c", "tag": "c20f6694-be45-4085-a244-f2e7042c5197"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:49:59.069592 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-4be4379c-7357-4178-a1b4-3a2779f7ea11 req-070d2178-d67a-4d7f-8c19-3b538afd13c3 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:59.077172 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-4be4379c-7357-4178-a1b4-3a2779f7ea11 req-070d2178-d67a-4d7f-8c19-3b538afd13c3 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:59.083295 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-4be4379c-7357-4178-a1b4-3a2779f7ea11 req-070d2178-d67a-4d7f-8c19-3b538afd13c3 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:59.116970 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-4be4379c-7357-4178-a1b4-3a2779f7ea11 req-070d2178-d67a-4d7f-8c19-3b538afd13c3 service nova] Creating event network-changed:c20f6694-be45-4085-a244-f2e7042c5197 for instance 89c20240-a307-4c2f-8121-6150803fef0c on hv-cinder-84456 Oct 03 12:49:59.130364 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-4be4379c-7357-4178-a1b4-3a2779f7ea11 req-070d2178-d67a-4d7f-8c19-3b538afd13c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223743 Oct 03 12:49:59.130980 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 23/53] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:49:59.531582 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d11b9bff-538e-4ef1-906a-dae6a56be3d6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:49:59.532568 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d11b9bff-538e-4ef1-906a-dae6a56be3d6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:49:59.552707 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d11b9bff-538e-4ef1-906a-dae6a56be3d6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:59.553457 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d11b9bff-538e-4ef1-906a-dae6a56be3d6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:59.553996 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d11b9bff-538e-4ef1-906a-dae6a56be3d6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:59.555679 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d11b9bff-538e-4ef1-906a-dae6a56be3d6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:49:59.557009 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d11b9bff-538e-4ef1-906a-dae6a56be3d6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:49:59.557459 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d11b9bff-538e-4ef1-906a-dae6a56be3d6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:49:59.924070 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-aff629eb-1486-4861-935b-eae70d9e37ce tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:49:59.933114 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-aff629eb-1486-4861-935b-eae70d9e37ce tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 1.202211 Oct 03 12:49:59.947812 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 31/54] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:58 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:49:59.957462 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-83152499", "imageRef": "9d585789-e496-433d-b311-70ec7ceffd99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "848e2135-07d9-46d2-afff-ed218ebac86b"}], "security_groups": [{"name": "tempest-securitygroup--1241594927"}], "key_name": "tempest-keypair-1409910373", "user_data": "}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:50:00.388911 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.network.neutron [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] validate_networks() for [('848e2135-07d9-46d2-afff-ed218ebac86b', None, None, None, None, None)] {{(pid=127542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:50:00.847582 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d11b9bff-538e-4ef1-906a-dae6a56be3d6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:00.865057 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d11b9bff-538e-4ef1-906a-dae6a56be3d6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 1.336230 Oct 03 12:50:00.866247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 24/55] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:49:59 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:00.963774 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-edd519d1-1c75-4800-ab86-c8b062fe5c21 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:00.964791 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-edd519d1-1c75-4800-ab86-c8b062fe5c21 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:00.976952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-edd519d1-1c75-4800-ab86-c8b062fe5c21 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:00.982025 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-edd519d1-1c75-4800-ab86-c8b062fe5c21 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:00.982025 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-edd519d1-1c75-4800-ab86-c8b062fe5c21 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:00.982442 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-edd519d1-1c75-4800-ab86-c8b062fe5c21 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:00.985129 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-edd519d1-1c75-4800-ab86-c8b062fe5c21 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:00.986588 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-edd519d1-1c75-4800-ab86-c8b062fe5c21 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:01.945252 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-edd519d1-1c75-4800-ab86-c8b062fe5c21 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:01.960861 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-edd519d1-1c75-4800-ab86-c8b062fe5c21 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 1.001990 Oct 03 12:50:01.962241 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 25/56] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:00 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:01.975937 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-372425090", "imageRef": "9d585789-e496-433d-b311-70ec7ceffd99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99c96330-3d0c-4416-8b2d-15be2ccdbc1b"}], "security_groups": [{"name": "tempest-securitygroup--1737921926"}], "key_name": "tempest-keypair-1854368905", "user_data": "}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:50:02.382796 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.network.neutron [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] validate_networks() for [('99c96330-3d0c-4416-8b2d-15be2ccdbc1b', None, None, None, None, None)] {{(pid=127544) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:50:02.792677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Flavor limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:50:02.793663 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Image limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:50:02.794271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Flavor pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:50:02.794916 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Image pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:50:02.795563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:50:02.809533 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:02.810240 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:02.811246 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:02.812399 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:02.813063 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:02.813509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:02.841945 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Getting quotas for project cc40d256f0e24050b6b53fdbcbce1962. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:50:02.848640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Getting quotas for user bd24d209dc9644e8b2860a0e676acd3b and project cc40d256f0e24050b6b53fdbcbce1962. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:50:02.893974 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Going to run 1 instances... {{(pid=127542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:50:02.896545 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d585789-e496-433d-b311-70ec7ceffd99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:50:03.088784 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e2507a63-1d38-4cb7-adc8-761108580302 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.139482 Oct 03 12:50:03.104809 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 32/57] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:49:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 3145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:50:03.107532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-39de5712-5482-47b4-9047-9a1a4f191bc7 req-1a8eb808-6893-4271-9239-2c0bfed89d83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea0723fe-401f-47ef-8b51-22dd148860e9", "tag": "edee2177-f99c-4159-b115-94dfdb5803e0"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:50:03.157536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-39de5712-5482-47b4-9047-9a1a4f191bc7 req-1a8eb808-6893-4271-9239-2c0bfed89d83 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:03.159819 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-39de5712-5482-47b4-9047-9a1a4f191bc7 req-1a8eb808-6893-4271-9239-2c0bfed89d83 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:03.160593 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-39de5712-5482-47b4-9047-9a1a4f191bc7 req-1a8eb808-6893-4271-9239-2c0bfed89d83 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:03.202762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-39de5712-5482-47b4-9047-9a1a4f191bc7 req-1a8eb808-6893-4271-9239-2c0bfed89d83 service nova] Creating event network-changed:edee2177-f99c-4159-b115-94dfdb5803e0 for instance ea0723fe-401f-47ef-8b51-22dd148860e9 on hv-cinder-84456 Oct 03 12:50:03.202762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-39de5712-5482-47b4-9047-9a1a4f191bc7 req-1a8eb808-6893-4271-9239-2c0bfed89d83 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 12:50:03.202762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-39de5712-5482-47b4-9047-9a1a4f191bc7 req-1a8eb808-6893-4271-9239-2c0bfed89d83 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 12:50:03.202762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-070916fd-2ae6-48c9-8814-1f49ffd9988f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:03.202762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-070916fd-2ae6-48c9-8814-1f49ffd9988f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:03.203381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-070916fd-2ae6-48c9-8814-1f49ffd9988f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:03.203381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-070916fd-2ae6-48c9-8814-1f49ffd9988f None None] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:03.203381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-070916fd-2ae6-48c9-8814-1f49ffd9988f None None] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:03.203743 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-070916fd-2ae6-48c9-8814-1f49ffd9988f None None] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:03.213964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.compute.rpcapi [None req-070916fd-2ae6-48c9-8814-1f49ffd9988f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 03 12:50:03.215825 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-070916fd-2ae6-48c9-8814-1f49ffd9988f None None] Releasing lock "compute-rpcapi-router" {{(pid=127542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 12:50:03.250740 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-070916fd-2ae6-48c9-8814-1f49ffd9988f None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149647 Oct 03 12:50:03.252665 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 33/58] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:50:03.259147 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-68517155-f3ca-4314-b93c-3e989771c68d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:03.260100 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-68517155-f3ca-4314-b93c-3e989771c68d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:03.278095 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-68517155-f3ca-4314-b93c-3e989771c68d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:03.279455 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-68517155-f3ca-4314-b93c-3e989771c68d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:03.281314 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-68517155-f3ca-4314-b93c-3e989771c68d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:03.282277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-68517155-f3ca-4314-b93c-3e989771c68d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:03.284167 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-68517155-f3ca-4314-b93c-3e989771c68d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:03.284771 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-68517155-f3ca-4314-b93c-3e989771c68d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:03.937577 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-68517155-f3ca-4314-b93c-3e989771c68d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:03.947253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-68517155-f3ca-4314-b93c-3e989771c68d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 0.692991 Oct 03 12:50:03.948695 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 34/59] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:03 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:03.954802 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-2c28fcf1-ed87-43bf-b9bc-ffd126565e50 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:03.955901 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-2c28fcf1-ed87-43bf-b9bc-ffd126565e50 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:03.963768 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2c28fcf1-ed87-43bf-b9bc-ffd126565e50 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:03.964385 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2c28fcf1-ed87-43bf-b9bc-ffd126565e50 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:03.965127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2c28fcf1-ed87-43bf-b9bc-ffd126565e50 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:03.965773 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2c28fcf1-ed87-43bf-b9bc-ffd126565e50 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:03.966335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2c28fcf1-ed87-43bf-b9bc-ffd126565e50 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:03.966899 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2c28fcf1-ed87-43bf-b9bc-ffd126565e50 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:04.169292 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Flavor limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:50:04.170958 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Image limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:50:04.171783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Flavor pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:50:04.172207 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Image pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:50:04.172626 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:50:04.186698 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:04.188849 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:04.188849 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:04.190033 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:04.191124 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:04.192010 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:04.239471 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Getting quotas for project 0e20f793bd0b46a59df730183818d9f8. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:50:04.263651 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Getting quotas for user 676b2a6bbf6e4df1b47dba2a9b8e8862 and project 0e20f793bd0b46a59df730183818d9f8. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:50:04.287954 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Going to run 1 instances... {{(pid=127544) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:50:04.291335 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d585789-e496-433d-b311-70ec7ceffd99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:50:04.374510 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-2c28fcf1-ed87-43bf-b9bc-ffd126565e50 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:04.394355 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-2c28fcf1-ed87-43bf-b9bc-ffd126565e50 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 0.434584 Oct 03 12:50:04.394355 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 35/60] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:03 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:04.394355 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-87a85672-46c9-43df-aa75-d8268db664e9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:04.394355 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-87a85672-46c9-43df-aa75-d8268db664e9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:04.480630 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-87a85672-46c9-43df-aa75-d8268db664e9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:04.488513 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-87a85672-46c9-43df-aa75-d8268db664e9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1236 microversion: 2.1 time: 0.101987 Oct 03 12:50:04.489062 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 36/61] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:04 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1236 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:04.628769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-3fbe644f-de25-4273-8d1d-6b34a026ce6a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.664389 Oct 03 12:50:04.630272 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 26/62] 10.222.0.33 () {62 vars in 1188 bytes} [Mon Oct 3 12:50:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 2667 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 12:50:04.651593 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-6e875f4b-1c66-4bb1-a413-4f45bb41f821 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:04.652528 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-6e875f4b-1c66-4bb1-a413-4f45bb41f821 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:04.726461 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6e875f4b-1c66-4bb1-a413-4f45bb41f821 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:04.736243 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6e875f4b-1c66-4bb1-a413-4f45bb41f821 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:04.738679 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6e875f4b-1c66-4bb1-a413-4f45bb41f821 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:04.739890 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-6e875f4b-1c66-4bb1-a413-4f45bb41f821 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1281 microversion: 2.20 time: 0.094118 Oct 03 12:50:04.753957 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 37/63] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:04 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1281 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:50:04.979661 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-952191d4-300b-479f-8132-8fe1371e3af3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:04.980380 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-952191d4-300b-479f-8132-8fe1371e3af3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:04.991280 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-952191d4-300b-479f-8132-8fe1371e3af3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:04.992542 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-952191d4-300b-479f-8132-8fe1371e3af3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:04.993597 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-952191d4-300b-479f-8132-8fe1371e3af3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:04.994647 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-952191d4-300b-479f-8132-8fe1371e3af3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:04.995306 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-952191d4-300b-479f-8132-8fe1371e3af3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:04.996081 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-952191d4-300b-479f-8132-8fe1371e3af3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:05.003946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=61 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:05.183687 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-952191d4-300b-479f-8132-8fe1371e3af3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:05.192438 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-952191d4-300b-479f-8132-8fe1371e3af3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 0.223984 Oct 03 12:50:05.193119 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 27/64] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:04 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:05.416907 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0c832c9d-5fdc-4f90-9ff8-05ec0d47ba5f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:05.418458 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-0c832c9d-5fdc-4f90-9ff8-05ec0d47ba5f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:05.426089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0c832c9d-5fdc-4f90-9ff8-05ec0d47ba5f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:05.426816 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0c832c9d-5fdc-4f90-9ff8-05ec0d47ba5f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:05.427264 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0c832c9d-5fdc-4f90-9ff8-05ec0d47ba5f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:05.428373 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0c832c9d-5fdc-4f90-9ff8-05ec0d47ba5f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:05.429034 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0c832c9d-5fdc-4f90-9ff8-05ec0d47ba5f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:05.429564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0c832c9d-5fdc-4f90-9ff8-05ec0d47ba5f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:05.511919 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a406c69f-6981-4f8d-bf9a-3a5fa0172c70 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:05.512727 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a406c69f-6981-4f8d-bf9a-3a5fa0172c70 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:05.522576 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a406c69f-6981-4f8d-bf9a-3a5fa0172c70 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:05.522576 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a406c69f-6981-4f8d-bf9a-3a5fa0172c70 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:05.522576 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a406c69f-6981-4f8d-bf9a-3a5fa0172c70 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:05.523519 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a406c69f-6981-4f8d-bf9a-3a5fa0172c70 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:05.524115 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a406c69f-6981-4f8d-bf9a-3a5fa0172c70 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:05.524694 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a406c69f-6981-4f8d-bf9a-3a5fa0172c70 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:05.575862 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0c832c9d-5fdc-4f90-9ff8-05ec0d47ba5f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:05.584949 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-0c832c9d-5fdc-4f90-9ff8-05ec0d47ba5f tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 0.172603 Oct 03 12:50:05.585531 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 38/65] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:05 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:05.619249 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-a406c69f-6981-4f8d-bf9a-3a5fa0172c70 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:05.627848 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a406c69f-6981-4f8d-bf9a-3a5fa0172c70 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1240 microversion: 2.1 time: 0.119565 Oct 03 12:50:05.628604 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 28/66] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:05 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1240 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:05.768434 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-628ea3a2-332c-44d8-8781-f15266fb5922 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:05.768434 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-628ea3a2-332c-44d8-8781-f15266fb5922 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:05.849200 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-628ea3a2-332c-44d8-8781-f15266fb5922 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:05.858543 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-628ea3a2-332c-44d8-8781-f15266fb5922 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:05.860197 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-628ea3a2-332c-44d8-8781-f15266fb5922 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:05.861902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-628ea3a2-332c-44d8-8781-f15266fb5922 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1281 microversion: 2.20 time: 0.099819 Oct 03 12:50:05.866618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 39/67] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:05 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1281 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:50:06.219835 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c94a96d2-70d8-469f-9519-56f5602241d9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:06.221222 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-c94a96d2-70d8-469f-9519-56f5602241d9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:06.224335 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:06.228247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c94a96d2-70d8-469f-9519-56f5602241d9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:06.228914 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c94a96d2-70d8-469f-9519-56f5602241d9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:06.229755 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c94a96d2-70d8-469f-9519-56f5602241d9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:06.230383 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c94a96d2-70d8-469f-9519-56f5602241d9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:06.230939 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c94a96d2-70d8-469f-9519-56f5602241d9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:06.231587 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c94a96d2-70d8-469f-9519-56f5602241d9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:06.383610 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c94a96d2-70d8-469f-9519-56f5602241d9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:06.391527 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c94a96d2-70d8-469f-9519-56f5602241d9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 0.176069 Oct 03 12:50:06.392264 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 29/68] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:06 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:06.608271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0d24fb4c-7391-450f-997d-ccf78056dbb1 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:06.608902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-0d24fb4c-7391-450f-997d-ccf78056dbb1 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:06.615553 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0d24fb4c-7391-450f-997d-ccf78056dbb1 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:06.616094 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0d24fb4c-7391-450f-997d-ccf78056dbb1 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:06.616723 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0d24fb4c-7391-450f-997d-ccf78056dbb1 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:06.617574 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0d24fb4c-7391-450f-997d-ccf78056dbb1 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:06.618095 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0d24fb4c-7391-450f-997d-ccf78056dbb1 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:06.618877 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0d24fb4c-7391-450f-997d-ccf78056dbb1 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:06.653111 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ca5a357a-73dc-4a34-96ee-19908452ccf5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:06.653730 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ca5a357a-73dc-4a34-96ee-19908452ccf5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:06.660134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ca5a357a-73dc-4a34-96ee-19908452ccf5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:06.660792 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ca5a357a-73dc-4a34-96ee-19908452ccf5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:06.661403 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ca5a357a-73dc-4a34-96ee-19908452ccf5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:06.662140 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ca5a357a-73dc-4a34-96ee-19908452ccf5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:06.662606 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ca5a357a-73dc-4a34-96ee-19908452ccf5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:06.663149 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ca5a357a-73dc-4a34-96ee-19908452ccf5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:06.738802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-ca5a357a-73dc-4a34-96ee-19908452ccf5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:06.747796 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ca5a357a-73dc-4a34-96ee-19908452ccf5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1240 microversion: 2.1 time: 0.100259 Oct 03 12:50:06.748698 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 30/69] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:06 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1240 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:06.797757 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0d24fb4c-7391-450f-997d-ccf78056dbb1 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:06.813643 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-0d24fb4c-7391-450f-997d-ccf78056dbb1 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 0.209508 Oct 03 12:50:06.827011 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 40/70] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:06 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:06.896344 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bf769cc9-0db3-46cd-9294-e0e48de780f6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:06.897057 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-bf769cc9-0db3-46cd-9294-e0e48de780f6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:06.903290 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf769cc9-0db3-46cd-9294-e0e48de780f6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:06.903825 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf769cc9-0db3-46cd-9294-e0e48de780f6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:06.904328 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf769cc9-0db3-46cd-9294-e0e48de780f6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:06.905032 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf769cc9-0db3-46cd-9294-e0e48de780f6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:06.905490 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf769cc9-0db3-46cd-9294-e0e48de780f6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:06.905918 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf769cc9-0db3-46cd-9294-e0e48de780f6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:06.967059 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-bf769cc9-0db3-46cd-9294-e0e48de780f6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:06.975702 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-bf769cc9-0db3-46cd-9294-e0e48de780f6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:06.977155 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-bf769cc9-0db3-46cd-9294-e0e48de780f6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:06.978264 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-bf769cc9-0db3-46cd-9294-e0e48de780f6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1285 microversion: 2.20 time: 0.086661 Oct 03 12:50:06.978822 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 31/71] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:06 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:50:07.417053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d2ff24d2-36f1-4de8-9506-c973973f86a1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:07.418095 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d2ff24d2-36f1-4de8-9506-c973973f86a1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:07.426401 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:07.428345 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2ff24d2-36f1-4de8-9506-c973973f86a1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:07.429051 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2ff24d2-36f1-4de8-9506-c973973f86a1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:07.429560 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2ff24d2-36f1-4de8-9506-c973973f86a1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:07.430678 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2ff24d2-36f1-4de8-9506-c973973f86a1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:07.431616 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2ff24d2-36f1-4de8-9506-c973973f86a1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:07.432249 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2ff24d2-36f1-4de8-9506-c973973f86a1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:07.651717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d2ff24d2-36f1-4de8-9506-c973973f86a1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:07.662676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d2ff24d2-36f1-4de8-9506-c973973f86a1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 0.251291 Oct 03 12:50:07.663231 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 41/72] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:07 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:07.772472 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bb4e88a7-ac56-4d8a-96c4-0384e997fc90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:07.773780 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-bb4e88a7-ac56-4d8a-96c4-0384e997fc90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:07.780958 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb4e88a7-ac56-4d8a-96c4-0384e997fc90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:07.781947 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb4e88a7-ac56-4d8a-96c4-0384e997fc90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:07.782820 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb4e88a7-ac56-4d8a-96c4-0384e997fc90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:07.798909 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb4e88a7-ac56-4d8a-96c4-0384e997fc90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:07.799682 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb4e88a7-ac56-4d8a-96c4-0384e997fc90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:07.802558 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb4e88a7-ac56-4d8a-96c4-0384e997fc90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:07.837866 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4146a885-5a73-46b3-aee0-38234a72e3c7 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:07.838597 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-4146a885-5a73-46b3-aee0-38234a72e3c7 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:07.845369 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4146a885-5a73-46b3-aee0-38234a72e3c7 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:07.848619 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4146a885-5a73-46b3-aee0-38234a72e3c7 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:07.848619 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4146a885-5a73-46b3-aee0-38234a72e3c7 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:07.848619 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4146a885-5a73-46b3-aee0-38234a72e3c7 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:07.848619 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4146a885-5a73-46b3-aee0-38234a72e3c7 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:07.848911 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4146a885-5a73-46b3-aee0-38234a72e3c7 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:07.866278 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-bb4e88a7-ac56-4d8a-96c4-0384e997fc90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:07.883465 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-bb4e88a7-ac56-4d8a-96c4-0384e997fc90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1232 microversion: 2.1 time: 0.115863 Oct 03 12:50:07.900359 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 32/73] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:07 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1232 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:08.003943 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4146a885-5a73-46b3-aee0-38234a72e3c7 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:08.007746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-72797f06-2dbd-4b1b-802d-294b276e10db tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:08.008397 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-72797f06-2dbd-4b1b-802d-294b276e10db tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:08.020721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-4146a885-5a73-46b3-aee0-38234a72e3c7 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 0.184381 Oct 03 12:50:08.032743 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-72797f06-2dbd-4b1b-802d-294b276e10db tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:08.032743 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-72797f06-2dbd-4b1b-802d-294b276e10db tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:08.032743 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-72797f06-2dbd-4b1b-802d-294b276e10db tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:08.032743 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-72797f06-2dbd-4b1b-802d-294b276e10db tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:08.033248 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-72797f06-2dbd-4b1b-802d-294b276e10db tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:08.033248 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-72797f06-2dbd-4b1b-802d-294b276e10db tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:08.038292 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 42/74] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:07 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:08.106963 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-72797f06-2dbd-4b1b-802d-294b276e10db tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:08.119861 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-72797f06-2dbd-4b1b-802d-294b276e10db tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:08.121607 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-72797f06-2dbd-4b1b-802d-294b276e10db tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:08.122857 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-72797f06-2dbd-4b1b-802d-294b276e10db tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1277 microversion: 2.20 time: 0.122989 Oct 03 12:50:08.123507 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 33/75] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:07 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:50:08.684725 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0ca66338-9d14-46ec-b2e5-10d66d9723c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:08.685376 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-0ca66338-9d14-46ec-b2e5-10d66d9723c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:08.692017 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ca66338-9d14-46ec-b2e5-10d66d9723c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:08.692517 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ca66338-9d14-46ec-b2e5-10d66d9723c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:08.692931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ca66338-9d14-46ec-b2e5-10d66d9723c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:08.693615 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ca66338-9d14-46ec-b2e5-10d66d9723c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:08.694066 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ca66338-9d14-46ec-b2e5-10d66d9723c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:08.694488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ca66338-9d14-46ec-b2e5-10d66d9723c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:08.698500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=100 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:08.847106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0ca66338-9d14-46ec-b2e5-10d66d9723c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:08.856728 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-0ca66338-9d14-46ec-b2e5-10d66d9723c1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 0.175850 Oct 03 12:50:08.859349 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 43/76] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:08 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:08.912115 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-f367edc2-357a-496b-a867-595fdaef8c16 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:08.913325 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-f367edc2-357a-496b-a867-595fdaef8c16 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:08.922800 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f367edc2-357a-496b-a867-595fdaef8c16 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:08.923392 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f367edc2-357a-496b-a867-595fdaef8c16 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:08.925472 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f367edc2-357a-496b-a867-595fdaef8c16 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:08.926217 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f367edc2-357a-496b-a867-595fdaef8c16 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:08.927906 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f367edc2-357a-496b-a867-595fdaef8c16 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:08.928999 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f367edc2-357a-496b-a867-595fdaef8c16 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:09.002986 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-f367edc2-357a-496b-a867-595fdaef8c16 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:09.013777 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-f367edc2-357a-496b-a867-595fdaef8c16 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1296 microversion: 2.1 time: 0.106186 Oct 03 12:50:09.024208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 34/77] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:08 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1296 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:09.045856 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d2c4a373-6a51-4687-a40a-482fd47ba4b6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:09.046616 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d2c4a373-6a51-4687-a40a-482fd47ba4b6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:09.061585 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2c4a373-6a51-4687-a40a-482fd47ba4b6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:09.062080 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2c4a373-6a51-4687-a40a-482fd47ba4b6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:09.065244 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2c4a373-6a51-4687-a40a-482fd47ba4b6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:09.066001 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2c4a373-6a51-4687-a40a-482fd47ba4b6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:09.067967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2c4a373-6a51-4687-a40a-482fd47ba4b6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:09.068486 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2c4a373-6a51-4687-a40a-482fd47ba4b6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:09.151632 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-169a0fda-4883-4f33-a788-8a08cca964ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:09.152612 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-169a0fda-4883-4f33-a788-8a08cca964ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:09.175648 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-169a0fda-4883-4f33-a788-8a08cca964ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:09.176395 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-169a0fda-4883-4f33-a788-8a08cca964ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:09.177903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-169a0fda-4883-4f33-a788-8a08cca964ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:09.180505 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-169a0fda-4883-4f33-a788-8a08cca964ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:09.180805 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-169a0fda-4883-4f33-a788-8a08cca964ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:09.182134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-169a0fda-4883-4f33-a788-8a08cca964ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:09.310450 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-169a0fda-4883-4f33-a788-8a08cca964ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:09.321829 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-169a0fda-4883-4f33-a788-8a08cca964ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:09.323489 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-169a0fda-4883-4f33-a788-8a08cca964ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:09.324833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-169a0fda-4883-4f33-a788-8a08cca964ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1333 microversion: 2.20 time: 0.178554 Oct 03 12:50:09.339560 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 35/78] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:09 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1333 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:50:09.371832 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d2c4a373-6a51-4687-a40a-482fd47ba4b6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:09.381823 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d2c4a373-6a51-4687-a40a-482fd47ba4b6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 0.340327 Oct 03 12:50:09.382514 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 44/79] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:09 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:09.925613 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0c8e2f41-b363-4c39-882f-ebbb5a7af655 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:09.925613 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-0c8e2f41-b363-4c39-882f-ebbb5a7af655 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:09.925613 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0c8e2f41-b363-4c39-882f-ebbb5a7af655 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:09.925613 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0c8e2f41-b363-4c39-882f-ebbb5a7af655 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:09.926514 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0c8e2f41-b363-4c39-882f-ebbb5a7af655 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:09.926514 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0c8e2f41-b363-4c39-882f-ebbb5a7af655 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:09.926514 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0c8e2f41-b363-4c39-882f-ebbb5a7af655 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:09.926514 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0c8e2f41-b363-4c39-882f-ebbb5a7af655 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:10.037561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-9d012b18-e7ed-4a13-bd1d-22f9521b9925 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:10.038197 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-9d012b18-e7ed-4a13-bd1d-22f9521b9925 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:10.044505 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9d012b18-e7ed-4a13-bd1d-22f9521b9925 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:10.045009 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9d012b18-e7ed-4a13-bd1d-22f9521b9925 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:10.045446 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9d012b18-e7ed-4a13-bd1d-22f9521b9925 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:10.046160 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9d012b18-e7ed-4a13-bd1d-22f9521b9925 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:10.046619 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9d012b18-e7ed-4a13-bd1d-22f9521b9925 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:10.047045 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9d012b18-e7ed-4a13-bd1d-22f9521b9925 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:10.252348 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-9d012b18-e7ed-4a13-bd1d-22f9521b9925 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:10.260333 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-9d012b18-e7ed-4a13-bd1d-22f9521b9925 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1294 microversion: 2.1 time: 0.227137 Oct 03 12:50:10.261353 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 45/80] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:10 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1294 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:10.359856 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-44bb220f-3dd3-48d3-86f0-5eda289dd4b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:10.359856 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-44bb220f-3dd3-48d3-86f0-5eda289dd4b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:10.363420 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44bb220f-3dd3-48d3-86f0-5eda289dd4b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:10.364215 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44bb220f-3dd3-48d3-86f0-5eda289dd4b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:10.365038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44bb220f-3dd3-48d3-86f0-5eda289dd4b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:10.366105 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44bb220f-3dd3-48d3-86f0-5eda289dd4b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:10.366724 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44bb220f-3dd3-48d3-86f0-5eda289dd4b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:10.367696 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44bb220f-3dd3-48d3-86f0-5eda289dd4b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:10.377917 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0c8e2f41-b363-4c39-882f-ebbb5a7af655 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:10.398860 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0c8e2f41-b363-4c39-882f-ebbb5a7af655 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 0.521258 Oct 03 12:50:10.404127 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 36/81] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:09 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:10.414728 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-84b921d3-fa70-40a9-a7b6-52229e7ed8aa tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:10.415405 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-84b921d3-fa70-40a9-a7b6-52229e7ed8aa tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:10.421368 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-84b921d3-fa70-40a9-a7b6-52229e7ed8aa tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:10.421872 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-84b921d3-fa70-40a9-a7b6-52229e7ed8aa tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:10.422308 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-84b921d3-fa70-40a9-a7b6-52229e7ed8aa tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:10.423014 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-84b921d3-fa70-40a9-a7b6-52229e7ed8aa tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:10.423544 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-84b921d3-fa70-40a9-a7b6-52229e7ed8aa tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:10.423952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-84b921d3-fa70-40a9-a7b6-52229e7ed8aa tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:10.451371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-44bb220f-3dd3-48d3-86f0-5eda289dd4b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:10.460522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-44bb220f-3dd3-48d3-86f0-5eda289dd4b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:10.461971 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-44bb220f-3dd3-48d3-86f0-5eda289dd4b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:10.463280 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-44bb220f-3dd3-48d3-86f0-5eda289dd4b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1341 microversion: 2.20 time: 0.114830 Oct 03 12:50:10.463881 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 46/82] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:10 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1341 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:50:10.574419 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-84b921d3-fa70-40a9-a7b6-52229e7ed8aa tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:10.582180 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-84b921d3-fa70-40a9-a7b6-52229e7ed8aa tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 0.176507 Oct 03 12:50:10.582749 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 37/83] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:10 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:11.287942 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-164c4281-8af5-40a7-af06-648f96b8670d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:11.288601 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-164c4281-8af5-40a7-af06-648f96b8670d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:11.302072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-164c4281-8af5-40a7-af06-648f96b8670d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:11.304695 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-164c4281-8af5-40a7-af06-648f96b8670d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:11.305358 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-164c4281-8af5-40a7-af06-648f96b8670d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:11.306775 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-164c4281-8af5-40a7-af06-648f96b8670d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:11.309908 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-164c4281-8af5-40a7-af06-648f96b8670d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:11.309908 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-164c4281-8af5-40a7-af06-648f96b8670d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:11.422582 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-1b2363f8-e48f-427b-8363-e3f18e289a84 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:11.425451 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-1b2363f8-e48f-427b-8363-e3f18e289a84 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:11.435662 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1b2363f8-e48f-427b-8363-e3f18e289a84 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:11.436187 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1b2363f8-e48f-427b-8363-e3f18e289a84 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:11.436629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1b2363f8-e48f-427b-8363-e3f18e289a84 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:11.440443 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1b2363f8-e48f-427b-8363-e3f18e289a84 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:11.441327 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1b2363f8-e48f-427b-8363-e3f18e289a84 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:11.443247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1b2363f8-e48f-427b-8363-e3f18e289a84 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:11.820991 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-164c4281-8af5-40a7-af06-648f96b8670d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:11.832814 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-164c4281-8af5-40a7-af06-648f96b8670d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1362 microversion: 2.1 time: 0.548763 Oct 03 12:50:11.834275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 47/84] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:11 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1362 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:11.840833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-1b2363f8-e48f-427b-8363-e3f18e289a84 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:11.842578 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8a300f2b-acf6-4e91-8375-e0818477e60a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:11.843885 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8a300f2b-acf6-4e91-8375-e0818477e60a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:11.852158 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-1b2363f8-e48f-427b-8363-e3f18e289a84 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 0.433496 Oct 03 12:50:11.854424 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 38/85] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:11 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:11.872189 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-20028547-dfae-454d-b056-0daca6c74d92 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:11.872189 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-20028547-dfae-454d-b056-0daca6c74d92 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:11.877049 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20028547-dfae-454d-b056-0daca6c74d92 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:11.877550 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20028547-dfae-454d-b056-0daca6c74d92 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:11.877989 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20028547-dfae-454d-b056-0daca6c74d92 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:11.884185 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20028547-dfae-454d-b056-0daca6c74d92 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:11.884670 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20028547-dfae-454d-b056-0daca6c74d92 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:11.885281 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20028547-dfae-454d-b056-0daca6c74d92 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:11.890170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8a300f2b-acf6-4e91-8375-e0818477e60a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:11.890696 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8a300f2b-acf6-4e91-8375-e0818477e60a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:11.891562 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8a300f2b-acf6-4e91-8375-e0818477e60a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:11.894215 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8a300f2b-acf6-4e91-8375-e0818477e60a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:11.894990 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8a300f2b-acf6-4e91-8375-e0818477e60a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:11.895588 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8a300f2b-acf6-4e91-8375-e0818477e60a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:12.224134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-20028547-dfae-454d-b056-0daca6c74d92 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:12.232957 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-20028547-dfae-454d-b056-0daca6c74d92 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 0.377292 Oct 03 12:50:12.233617 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 39/86] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:11 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:12.246938 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8a300f2b-acf6-4e91-8375-e0818477e60a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:12.257723 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8a300f2b-acf6-4e91-8375-e0818477e60a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:12.259269 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8a300f2b-acf6-4e91-8375-e0818477e60a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:12.260519 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8a300f2b-acf6-4e91-8375-e0818477e60a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.424353 Oct 03 12:50:12.261165 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 48/87] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:11 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:50:12.548959 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-b80b4c51-ff18-41b0-bcf4-6badb7287742 req-2797ae04-0348-4791-9f1c-299badc4ee74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a980d091-a942-46bc-a139-d12f9e2167ed", "tag": "b6c921d4-a92a-4c27-89cc-adf792fee725"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:50:12.559671 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-b80b4c51-ff18-41b0-bcf4-6badb7287742 req-2797ae04-0348-4791-9f1c-299badc4ee74 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:12.560240 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-b80b4c51-ff18-41b0-bcf4-6badb7287742 req-2797ae04-0348-4791-9f1c-299badc4ee74 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:12.560603 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-b80b4c51-ff18-41b0-bcf4-6badb7287742 req-2797ae04-0348-4791-9f1c-299badc4ee74 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:12.572117 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-b80b4c51-ff18-41b0-bcf4-6badb7287742 req-2797ae04-0348-4791-9f1c-299badc4ee74 service nova] Creating event network-changed:b6c921d4-a92a-4c27-89cc-adf792fee725 for instance a980d091-a942-46bc-a139-d12f9e2167ed on hv-cinder-84456 Oct 03 12:50:12.577205 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-b80b4c51-ff18-41b0-bcf4-6badb7287742 req-2797ae04-0348-4791-9f1c-299badc4ee74 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033268 Oct 03 12:50:12.577800 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 40/88] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:50:12.858482 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-178e6908-7af1-4006-84c1-464b4a30b459 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:12.859232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-178e6908-7af1-4006-84c1-464b4a30b459 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:12.866828 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-178e6908-7af1-4006-84c1-464b4a30b459 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:12.870124 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-178e6908-7af1-4006-84c1-464b4a30b459 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:12.870124 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-178e6908-7af1-4006-84c1-464b4a30b459 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:12.870124 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-178e6908-7af1-4006-84c1-464b4a30b459 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:12.870124 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-178e6908-7af1-4006-84c1-464b4a30b459 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:12.870499 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-178e6908-7af1-4006-84c1-464b4a30b459 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:12.897795 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-11aaffa2-e372-473d-9ee0-bb0499f392ae tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:12.898904 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-11aaffa2-e372-473d-9ee0-bb0499f392ae tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:12.905758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11aaffa2-e372-473d-9ee0-bb0499f392ae tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:12.906313 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11aaffa2-e372-473d-9ee0-bb0499f392ae tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:12.907118 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11aaffa2-e372-473d-9ee0-bb0499f392ae tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:12.908818 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11aaffa2-e372-473d-9ee0-bb0499f392ae tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:12.909720 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11aaffa2-e372-473d-9ee0-bb0499f392ae tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:12.910380 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11aaffa2-e372-473d-9ee0-bb0499f392ae tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:13.055291 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-178e6908-7af1-4006-84c1-464b4a30b459 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:13.063984 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-178e6908-7af1-4006-84c1-464b4a30b459 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1362 microversion: 2.1 time: 0.210347 Oct 03 12:50:13.064769 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 49/89] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:12 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:13.084656 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-11aaffa2-e372-473d-9ee0-bb0499f392ae tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:13.092080 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-11aaffa2-e372-473d-9ee0-bb0499f392ae tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 0.198668 Oct 03 12:50:13.092638 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 41/90] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:12 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:13.258576 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-936f458d-127c-463c-975e-58e96819f97b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:13.259198 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-936f458d-127c-463c-975e-58e96819f97b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:13.261080 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=4 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:13.266306 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-936f458d-127c-463c-975e-58e96819f97b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:13.272411 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-936f458d-127c-463c-975e-58e96819f97b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:13.272411 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-936f458d-127c-463c-975e-58e96819f97b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:13.272411 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-936f458d-127c-463c-975e-58e96819f97b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:13.272411 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-936f458d-127c-463c-975e-58e96819f97b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:13.273307 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-936f458d-127c-463c-975e-58e96819f97b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:13.288515 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c0e80e72-48c0-4b8e-9bdd-e2aeacce84a8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:13.289136 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-c0e80e72-48c0-4b8e-9bdd-e2aeacce84a8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:13.295902 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c0e80e72-48c0-4b8e-9bdd-e2aeacce84a8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:13.296401 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c0e80e72-48c0-4b8e-9bdd-e2aeacce84a8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:13.297014 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c0e80e72-48c0-4b8e-9bdd-e2aeacce84a8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:13.298181 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c0e80e72-48c0-4b8e-9bdd-e2aeacce84a8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:13.298181 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c0e80e72-48c0-4b8e-9bdd-e2aeacce84a8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:13.299521 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c0e80e72-48c0-4b8e-9bdd-e2aeacce84a8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:13.467463 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-936f458d-127c-463c-975e-58e96819f97b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:13.475029 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c0e80e72-48c0-4b8e-9bdd-e2aeacce84a8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:13.476855 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-936f458d-127c-463c-975e-58e96819f97b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 0.222525 Oct 03 12:50:13.477831 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 50/91] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:13 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:13.484391 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c0e80e72-48c0-4b8e-9bdd-e2aeacce84a8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:13.485949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c0e80e72-48c0-4b8e-9bdd-e2aeacce84a8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:13.487987 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c0e80e72-48c0-4b8e-9bdd-e2aeacce84a8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.203495 Oct 03 12:50:13.488541 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 42/92] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:13 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:50:14.086614 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-31802b6c-0c10-46e8-a9e6-8bc601b1da3c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:14.087236 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-31802b6c-0c10-46e8-a9e6-8bc601b1da3c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:14.093793 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-31802b6c-0c10-46e8-a9e6-8bc601b1da3c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:14.094235 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-31802b6c-0c10-46e8-a9e6-8bc601b1da3c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:14.094689 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-31802b6c-0c10-46e8-a9e6-8bc601b1da3c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:14.095437 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-31802b6c-0c10-46e8-a9e6-8bc601b1da3c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:14.096444 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-31802b6c-0c10-46e8-a9e6-8bc601b1da3c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:14.096895 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-31802b6c-0c10-46e8-a9e6-8bc601b1da3c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:14.117281 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b4281c5b-cb0e-4494-a6e7-bdf827b73a2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:14.117902 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-b4281c5b-cb0e-4494-a6e7-bdf827b73a2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:14.124267 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b4281c5b-cb0e-4494-a6e7-bdf827b73a2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:14.124836 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b4281c5b-cb0e-4494-a6e7-bdf827b73a2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:14.125533 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b4281c5b-cb0e-4494-a6e7-bdf827b73a2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:14.127400 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b4281c5b-cb0e-4494-a6e7-bdf827b73a2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:14.127968 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b4281c5b-cb0e-4494-a6e7-bdf827b73a2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:14.128605 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b4281c5b-cb0e-4494-a6e7-bdf827b73a2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:14.202329 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=4 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:14.284050 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=6 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:14.579648 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-31802b6c-0c10-46e8-a9e6-8bc601b1da3c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:14.587488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-31802b6c-0c10-46e8-a9e6-8bc601b1da3c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1362 microversion: 2.1 time: 0.504724 Oct 03 12:50:14.588249 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 51/93] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:14 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1362 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:14.593029 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-53aecc44-6e58-49d1-a84b-dd8b97b1adfc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:14.593635 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-53aecc44-6e58-49d1-a84b-dd8b97b1adfc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:14.601018 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-b4281c5b-cb0e-4494-a6e7-bdf827b73a2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:14.602222 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53aecc44-6e58-49d1-a84b-dd8b97b1adfc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:14.602880 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53aecc44-6e58-49d1-a84b-dd8b97b1adfc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:14.603498 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53aecc44-6e58-49d1-a84b-dd8b97b1adfc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:14.604366 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53aecc44-6e58-49d1-a84b-dd8b97b1adfc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:14.605007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53aecc44-6e58-49d1-a84b-dd8b97b1adfc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:14.605574 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53aecc44-6e58-49d1-a84b-dd8b97b1adfc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:14.615636 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-b4281c5b-cb0e-4494-a6e7-bdf827b73a2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 0.503223 Oct 03 12:50:14.629368 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 43/94] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:14 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:14.640784 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2aee7f81-6a4a-4ae5-9062-432216e87029 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:14.641680 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2aee7f81-6a4a-4ae5-9062-432216e87029 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:14.648664 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2aee7f81-6a4a-4ae5-9062-432216e87029 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:14.650040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2aee7f81-6a4a-4ae5-9062-432216e87029 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:14.650549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2aee7f81-6a4a-4ae5-9062-432216e87029 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:14.651335 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2aee7f81-6a4a-4ae5-9062-432216e87029 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:14.651900 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2aee7f81-6a4a-4ae5-9062-432216e87029 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:14.652442 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2aee7f81-6a4a-4ae5-9062-432216e87029 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:14.668466 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=100 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:15.370508 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-53aecc44-6e58-49d1-a84b-dd8b97b1adfc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:15.380362 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2aee7f81-6a4a-4ae5-9062-432216e87029 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:15.381387 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-53aecc44-6e58-49d1-a84b-dd8b97b1adfc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 0.791977 Oct 03 12:50:15.382480 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 52/95] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:14 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:15.407930 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2aee7f81-6a4a-4ae5-9062-432216e87029 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:15.409683 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2aee7f81-6a4a-4ae5-9062-432216e87029 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:15.411054 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-2aee7f81-6a4a-4ae5-9062-432216e87029 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.780425 Oct 03 12:50:15.412090 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 44/96] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:14 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:50:15.617422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-93811422-05e4-4044-8f72-7419731599e0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:15.618419 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-93811422-05e4-4044-8f72-7419731599e0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:15.625469 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-93811422-05e4-4044-8f72-7419731599e0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:15.626193 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-93811422-05e4-4044-8f72-7419731599e0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:15.627278 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-93811422-05e4-4044-8f72-7419731599e0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:15.628247 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-93811422-05e4-4044-8f72-7419731599e0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:15.628875 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-93811422-05e4-4044-8f72-7419731599e0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:15.629360 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-93811422-05e4-4044-8f72-7419731599e0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:15.643792 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a8ceae44-b377-4df2-88de-41f3c63d06dd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:15.644415 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a8ceae44-b377-4df2-88de-41f3c63d06dd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:15.651109 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a8ceae44-b377-4df2-88de-41f3c63d06dd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:15.652003 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a8ceae44-b377-4df2-88de-41f3c63d06dd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:15.652601 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a8ceae44-b377-4df2-88de-41f3c63d06dd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:15.653461 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a8ceae44-b377-4df2-88de-41f3c63d06dd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:15.654067 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a8ceae44-b377-4df2-88de-41f3c63d06dd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:15.654645 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a8ceae44-b377-4df2-88de-41f3c63d06dd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:15.854022 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=12 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:16.104597 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-93811422-05e4-4044-8f72-7419731599e0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:16.113046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-93811422-05e4-4044-8f72-7419731599e0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1362 microversion: 2.1 time: 0.500628 Oct 03 12:50:16.129122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-a8ceae44-b377-4df2-88de-41f3c63d06dd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:16.132765 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 53/97] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:15 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1362 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:16.145192 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a8ceae44-b377-4df2-88de-41f3c63d06dd tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 0.501000 Oct 03 12:50:16.147593 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 45/98] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:15 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:16.398040 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-0713e1fb-71ea-44a1-a6b0-85309bae9694 req-565c321c-ee17-4883-8740-c092eda4af35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c20240-a307-4c2f-8121-6150803fef0c", "name": "network-vif-plugged", "status": "completed", "tag": "c20f6694-be45-4085-a244-f2e7042c5197"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:50:16.408701 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d31a14b8-9074-4df2-aca3-ed73c723b10b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:16.409498 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d31a14b8-9074-4df2-aca3-ed73c723b10b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:16.409748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-0713e1fb-71ea-44a1-a6b0-85309bae9694 req-565c321c-ee17-4883-8740-c092eda4af35 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:16.412545 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-0713e1fb-71ea-44a1-a6b0-85309bae9694 req-565c321c-ee17-4883-8740-c092eda4af35 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:16.412545 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-0713e1fb-71ea-44a1-a6b0-85309bae9694 req-565c321c-ee17-4883-8740-c092eda4af35 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:16.416514 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d31a14b8-9074-4df2-aca3-ed73c723b10b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:16.421862 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-0713e1fb-71ea-44a1-a6b0-85309bae9694 req-565c321c-ee17-4883-8740-c092eda4af35 service nova] Creating event network-vif-plugged:c20f6694-be45-4085-a244-f2e7042c5197 for instance 89c20240-a307-4c2f-8121-6150803fef0c on hv-cinder-84456 Oct 03 12:50:16.427357 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-0713e1fb-71ea-44a1-a6b0-85309bae9694 req-565c321c-ee17-4883-8740-c092eda4af35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.293222 Oct 03 12:50:16.427942 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 54/99] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:50:16.429338 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d31a14b8-9074-4df2-aca3-ed73c723b10b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:16.429976 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d31a14b8-9074-4df2-aca3-ed73c723b10b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:16.431568 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d31a14b8-9074-4df2-aca3-ed73c723b10b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:16.432365 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d31a14b8-9074-4df2-aca3-ed73c723b10b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:16.433163 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d31a14b8-9074-4df2-aca3-ed73c723b10b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:16.442115 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-aeb83ee6-cc3c-48b5-b75a-56b62297aeb1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:16.442115 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-aeb83ee6-cc3c-48b5-b75a-56b62297aeb1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:16.446215 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aeb83ee6-cc3c-48b5-b75a-56b62297aeb1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:16.446759 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aeb83ee6-cc3c-48b5-b75a-56b62297aeb1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:16.447193 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aeb83ee6-cc3c-48b5-b75a-56b62297aeb1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:16.447930 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aeb83ee6-cc3c-48b5-b75a-56b62297aeb1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:16.448384 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aeb83ee6-cc3c-48b5-b75a-56b62297aeb1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:16.448804 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aeb83ee6-cc3c-48b5-b75a-56b62297aeb1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:16.745450 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d31a14b8-9074-4df2-aca3-ed73c723b10b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:16.754770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-aeb83ee6-cc3c-48b5-b75a-56b62297aeb1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:16.764881 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-aeb83ee6-cc3c-48b5-b75a-56b62297aeb1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:16.769517 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d31a14b8-9074-4df2-aca3-ed73c723b10b tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 0.364712 Oct 03 12:50:16.785531 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-aeb83ee6-cc3c-48b5-b75a-56b62297aeb1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:16.785833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 46/100] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:16 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:16.791429 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-aeb83ee6-cc3c-48b5-b75a-56b62297aeb1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.356633 Oct 03 12:50:16.793316 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 55/101] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:16 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:50:16.795718 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-55d5dbeb-f621-4372-b802-27fe6a292ffe req-479ad82a-5b21-463a-b2e3-901d94ba8666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54982238-81ba-4d23-b642-e3a37f778b4a", "tag": "e846a01d-6972-40c0-b292-bc930ec8ca6d"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:50:16.806277 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-55d5dbeb-f621-4372-b802-27fe6a292ffe req-479ad82a-5b21-463a-b2e3-901d94ba8666 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:16.806981 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-55d5dbeb-f621-4372-b802-27fe6a292ffe req-479ad82a-5b21-463a-b2e3-901d94ba8666 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:16.807606 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-55d5dbeb-f621-4372-b802-27fe6a292ffe req-479ad82a-5b21-463a-b2e3-901d94ba8666 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:16.821300 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-55d5dbeb-f621-4372-b802-27fe6a292ffe req-479ad82a-5b21-463a-b2e3-901d94ba8666 service nova] Creating event network-changed:e846a01d-6972-40c0-b292-bc930ec8ca6d for instance 54982238-81ba-4d23-b642-e3a37f778b4a on hv-cinder-84456 Oct 03 12:50:16.827256 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-55d5dbeb-f621-4372-b802-27fe6a292ffe req-479ad82a-5b21-463a-b2e3-901d94ba8666 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039513 Oct 03 12:50:16.828076 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 47/102] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:50:17.137049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-be253503-adf7-4006-8bd8-e4b8a4310fe3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:17.137931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-be253503-adf7-4006-8bd8-e4b8a4310fe3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:17.144591 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-be253503-adf7-4006-8bd8-e4b8a4310fe3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:17.145088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-be253503-adf7-4006-8bd8-e4b8a4310fe3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:17.145533 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-be253503-adf7-4006-8bd8-e4b8a4310fe3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:17.146240 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-be253503-adf7-4006-8bd8-e4b8a4310fe3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:17.146706 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-be253503-adf7-4006-8bd8-e4b8a4310fe3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:17.147139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-be253503-adf7-4006-8bd8-e4b8a4310fe3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:17.174044 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2f63876d-f1c8-4975-9493-9aa71d5720a8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:17.175495 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2f63876d-f1c8-4975-9493-9aa71d5720a8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:17.182697 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f63876d-f1c8-4975-9493-9aa71d5720a8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:17.183393 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f63876d-f1c8-4975-9493-9aa71d5720a8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:17.183652 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f63876d-f1c8-4975-9493-9aa71d5720a8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:17.184366 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f63876d-f1c8-4975-9493-9aa71d5720a8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:17.184966 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f63876d-f1c8-4975-9493-9aa71d5720a8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:17.185396 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f63876d-f1c8-4975-9493-9aa71d5720a8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:17.399306 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-be253503-adf7-4006-8bd8-e4b8a4310fe3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:17.409431 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-be253503-adf7-4006-8bd8-e4b8a4310fe3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1362 microversion: 2.1 time: 0.276152 Oct 03 12:50:17.410217 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 56/103] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:17 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:17.419102 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2f63876d-f1c8-4975-9493-9aa71d5720a8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:17.427669 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-2f63876d-f1c8-4975-9493-9aa71d5720a8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 0.258766 Oct 03 12:50:17.428234 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 48/104] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:17 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:17.795957 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-df8b9dcb-6574-4820-b1cd-15fa402c1844 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:17.796575 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-df8b9dcb-6574-4820-b1cd-15fa402c1844 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:17.802568 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-df8b9dcb-6574-4820-b1cd-15fa402c1844 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:17.803055 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-df8b9dcb-6574-4820-b1cd-15fa402c1844 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:17.803525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-df8b9dcb-6574-4820-b1cd-15fa402c1844 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:17.804215 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-df8b9dcb-6574-4820-b1cd-15fa402c1844 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:17.804675 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-df8b9dcb-6574-4820-b1cd-15fa402c1844 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:17.805100 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-df8b9dcb-6574-4820-b1cd-15fa402c1844 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:17.818056 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-5932dbe0-8dae-4639-8080-7462c7aea404 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:17.818719 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-5932dbe0-8dae-4639-8080-7462c7aea404 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:17.824919 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5932dbe0-8dae-4639-8080-7462c7aea404 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:17.825403 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5932dbe0-8dae-4639-8080-7462c7aea404 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:17.825834 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5932dbe0-8dae-4639-8080-7462c7aea404 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:17.826543 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5932dbe0-8dae-4639-8080-7462c7aea404 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:17.826975 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5932dbe0-8dae-4639-8080-7462c7aea404 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:17.827583 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5932dbe0-8dae-4639-8080-7462c7aea404 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:18.013797 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-df8b9dcb-6574-4820-b1cd-15fa402c1844 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:18.021425 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5932dbe0-8dae-4639-8080-7462c7aea404 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:18.022632 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-df8b9dcb-6574-4820-b1cd-15fa402c1844 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 0.230463 Oct 03 12:50:18.023239 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 57/105] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:17 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:18.030534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5932dbe0-8dae-4639-8080-7462c7aea404 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:18.032084 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5932dbe0-8dae-4639-8080-7462c7aea404 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:18.033633 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-5932dbe0-8dae-4639-8080-7462c7aea404 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.219460 Oct 03 12:50:18.034705 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 49/106] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:17 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:50:18.433979 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-dae9227c-8cc0-4b13-b1de-2cea0fca4567 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:18.435926 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-dae9227c-8cc0-4b13-b1de-2cea0fca4567 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:18.445901 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dae9227c-8cc0-4b13-b1de-2cea0fca4567 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:18.447089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dae9227c-8cc0-4b13-b1de-2cea0fca4567 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:18.448207 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dae9227c-8cc0-4b13-b1de-2cea0fca4567 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:18.449773 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dae9227c-8cc0-4b13-b1de-2cea0fca4567 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:18.450918 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dae9227c-8cc0-4b13-b1de-2cea0fca4567 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:18.451941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dae9227c-8cc0-4b13-b1de-2cea0fca4567 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:18.459942 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-336546b0-5437-43b1-8e49-68f7f5c68f81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:18.461105 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-336546b0-5437-43b1-8e49-68f7f5c68f81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:18.469386 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-336546b0-5437-43b1-8e49-68f7f5c68f81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:18.469883 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-336546b0-5437-43b1-8e49-68f7f5c68f81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:18.470513 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-336546b0-5437-43b1-8e49-68f7f5c68f81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:18.471504 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-336546b0-5437-43b1-8e49-68f7f5c68f81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:18.471973 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-336546b0-5437-43b1-8e49-68f7f5c68f81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:18.472538 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-336546b0-5437-43b1-8e49-68f7f5c68f81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:18.718790 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-dae9227c-8cc0-4b13-b1de-2cea0fca4567 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:18.730779 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-dae9227c-8cc0-4b13-b1de-2cea0fca4567 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1362 microversion: 2.1 time: 0.297371 Oct 03 12:50:18.733394 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-336546b0-5437-43b1-8e49-68f7f5c68f81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:18.743778 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 58/107] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:18 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:18.744497 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-336546b0-5437-43b1-8e49-68f7f5c68f81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 0.295770 Oct 03 12:50:18.749104 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 50/108] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:18 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:18.760976 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-d78d9a27-4219-4548-b1c1-a638f7af2d77 req-7916c6ca-907a-4e15-8a92-2faefbbffb13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9909a9d-feb5-4513-9e14-6aadc4e17c59", "name": "network-vif-plugged", "status": "completed", "tag": "ca96c603-3295-4d37-99aa-2b5b95419166"}, {"server_uuid": "ea0723fe-401f-47ef-8b51-22dd148860e9", "name": "network-vif-plugged", "status": "completed", "tag": "edee2177-f99c-4159-b115-94dfdb5803e0"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:50:18.775167 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-d78d9a27-4219-4548-b1c1-a638f7af2d77 req-7916c6ca-907a-4e15-8a92-2faefbbffb13 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:18.776020 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-d78d9a27-4219-4548-b1c1-a638f7af2d77 req-7916c6ca-907a-4e15-8a92-2faefbbffb13 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:18.776621 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-d78d9a27-4219-4548-b1c1-a638f7af2d77 req-7916c6ca-907a-4e15-8a92-2faefbbffb13 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:18.792101 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-d78d9a27-4219-4548-b1c1-a638f7af2d77 req-7916c6ca-907a-4e15-8a92-2faefbbffb13 service nova] Creating event network-vif-plugged:ca96c603-3295-4d37-99aa-2b5b95419166 for instance f9909a9d-feb5-4513-9e14-6aadc4e17c59 on hv-cinder-84456 Oct 03 12:50:18.792614 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-d78d9a27-4219-4548-b1c1-a638f7af2d77 req-7916c6ca-907a-4e15-8a92-2faefbbffb13 service nova] Creating event network-vif-plugged:edee2177-f99c-4159-b115-94dfdb5803e0 for instance ea0723fe-401f-47ef-8b51-22dd148860e9 on hv-cinder-84456 Oct 03 12:50:18.799957 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-d78d9a27-4219-4548-b1c1-a638f7af2d77 req-7916c6ca-907a-4e15-8a92-2faefbbffb13 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054667 Oct 03 12:50:18.800806 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 59/109] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:50:19.063533 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9245bbd3-3b56-4d7b-896c-c41c1d9d394a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:19.064665 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b315d0fb-6976-4577-9976-d724d1265a97 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:19.065219 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-9245bbd3-3b56-4d7b-896c-c41c1d9d394a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:19.065599 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b315d0fb-6976-4577-9976-d724d1265a97 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:19.071185 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9245bbd3-3b56-4d7b-896c-c41c1d9d394a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:19.071969 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b315d0fb-6976-4577-9976-d724d1265a97 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:19.072097 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9245bbd3-3b56-4d7b-896c-c41c1d9d394a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:19.072426 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9245bbd3-3b56-4d7b-896c-c41c1d9d394a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:19.072878 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b315d0fb-6976-4577-9976-d724d1265a97 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:19.073378 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9245bbd3-3b56-4d7b-896c-c41c1d9d394a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:19.073637 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b315d0fb-6976-4577-9976-d724d1265a97 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:19.074327 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9245bbd3-3b56-4d7b-896c-c41c1d9d394a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:19.074794 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b315d0fb-6976-4577-9976-d724d1265a97 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:19.075389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9245bbd3-3b56-4d7b-896c-c41c1d9d394a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:19.075848 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b315d0fb-6976-4577-9976-d724d1265a97 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:19.076418 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b315d0fb-6976-4577-9976-d724d1265a97 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:19.281349 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9245bbd3-3b56-4d7b-896c-c41c1d9d394a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:19.284056 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-b315d0fb-6976-4577-9976-d724d1265a97 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:19.293131 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-b315d0fb-6976-4577-9976-d724d1265a97 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 0.232752 Oct 03 12:50:19.293630 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 60/110] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:19 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:19.294685 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9245bbd3-3b56-4d7b-896c-c41c1d9d394a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:19.296185 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9245bbd3-3b56-4d7b-896c-c41c1d9d394a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:19.297357 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-9245bbd3-3b56-4d7b-896c-c41c1d9d394a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.237699 Oct 03 12:50:19.297907 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 51/111] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:19 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:50:19.772564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1833290b-0997-4e54-8632-8099c3556aec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:19.773109 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-1833290b-0997-4e54-8632-8099c3556aec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:19.775656 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-81586c08-c71f-434e-b4d7-ed61c67d0069 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:19.776810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-81586c08-c71f-434e-b4d7-ed61c67d0069 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:19.779113 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1833290b-0997-4e54-8632-8099c3556aec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:19.779631 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1833290b-0997-4e54-8632-8099c3556aec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:19.780220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1833290b-0997-4e54-8632-8099c3556aec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:19.781066 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1833290b-0997-4e54-8632-8099c3556aec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:19.781802 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1833290b-0997-4e54-8632-8099c3556aec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:19.782232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1833290b-0997-4e54-8632-8099c3556aec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:19.786932 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-81586c08-c71f-434e-b4d7-ed61c67d0069 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:19.787124 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=100 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:19.787606 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-81586c08-c71f-434e-b4d7-ed61c67d0069 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:19.788043 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-81586c08-c71f-434e-b4d7-ed61c67d0069 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:19.788816 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-81586c08-c71f-434e-b4d7-ed61c67d0069 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:19.789272 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-81586c08-c71f-434e-b4d7-ed61c67d0069 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:19.789696 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-81586c08-c71f-434e-b4d7-ed61c67d0069 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:20.055161 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-1833290b-0997-4e54-8632-8099c3556aec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:20.067498 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-1833290b-0997-4e54-8632-8099c3556aec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1362 microversion: 2.1 time: 0.295965 Oct 03 12:50:20.071680 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 61/112] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:19 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:20.101387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-81586c08-c71f-434e-b4d7-ed61c67d0069 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:20.114992 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-81586c08-c71f-434e-b4d7-ed61c67d0069 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 0.343056 Oct 03 12:50:20.118979 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 52/113] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:19 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:20.317625 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-82552453-81ea-4cb5-a21d-b3357afea86d tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:20.319271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-82552453-81ea-4cb5-a21d-b3357afea86d tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:20.327926 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-82552453-81ea-4cb5-a21d-b3357afea86d tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:20.328704 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-82552453-81ea-4cb5-a21d-b3357afea86d tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:20.329386 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-82552453-81ea-4cb5-a21d-b3357afea86d tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:20.330394 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-82552453-81ea-4cb5-a21d-b3357afea86d tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:20.331140 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-82552453-81ea-4cb5-a21d-b3357afea86d tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:20.331246 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-7493cc90-a5ea-49ab-9a65-bd8b4b8cf11f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:20.331923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-82552453-81ea-4cb5-a21d-b3357afea86d tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:20.332740 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-7493cc90-a5ea-49ab-9a65-bd8b4b8cf11f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:20.354056 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7493cc90-a5ea-49ab-9a65-bd8b4b8cf11f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:20.354803 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7493cc90-a5ea-49ab-9a65-bd8b4b8cf11f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:20.359983 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7493cc90-a5ea-49ab-9a65-bd8b4b8cf11f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:20.360738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7493cc90-a5ea-49ab-9a65-bd8b4b8cf11f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:20.379234 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7493cc90-a5ea-49ab-9a65-bd8b4b8cf11f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:20.379234 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7493cc90-a5ea-49ab-9a65-bd8b4b8cf11f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:21.074385 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-82552453-81ea-4cb5-a21d-b3357afea86d tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:21.079334 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7493cc90-a5ea-49ab-9a65-bd8b4b8cf11f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:21.092413 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-82552453-81ea-4cb5-a21d-b3357afea86d tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 0.779523 Oct 03 12:50:21.093691 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 62/114] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:20 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:21.098664 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c79508ca-1e0a-4306-9e83-471410441b91 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:21.099623 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c79508ca-1e0a-4306-9e83-471410441b91 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:21.105701 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c79508ca-1e0a-4306-9e83-471410441b91 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:21.106452 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c79508ca-1e0a-4306-9e83-471410441b91 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:21.107093 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c79508ca-1e0a-4306-9e83-471410441b91 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:21.108048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c79508ca-1e0a-4306-9e83-471410441b91 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:21.108673 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c79508ca-1e0a-4306-9e83-471410441b91 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:21.109293 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c79508ca-1e0a-4306-9e83-471410441b91 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:21.118919 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7493cc90-a5ea-49ab-9a65-bd8b4b8cf11f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:21.118919 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7493cc90-a5ea-49ab-9a65-bd8b4b8cf11f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:21.119537 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-7493cc90-a5ea-49ab-9a65-bd8b4b8cf11f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.792921 Oct 03 12:50:21.123164 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 53/115] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:20 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:50:21.141891 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-fdce37ad-8a1c-47bd-8e0a-8079a81b3dab tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:21.142711 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-fdce37ad-8a1c-47bd-8e0a-8079a81b3dab tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:21.165501 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fdce37ad-8a1c-47bd-8e0a-8079a81b3dab tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:21.165501 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fdce37ad-8a1c-47bd-8e0a-8079a81b3dab tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:21.165501 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fdce37ad-8a1c-47bd-8e0a-8079a81b3dab tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:21.165501 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fdce37ad-8a1c-47bd-8e0a-8079a81b3dab tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:21.166189 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fdce37ad-8a1c-47bd-8e0a-8079a81b3dab tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:21.166189 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fdce37ad-8a1c-47bd-8e0a-8079a81b3dab tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:21.302636 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c79508ca-1e0a-4306-9e83-471410441b91 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:21.311923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c79508ca-1e0a-4306-9e83-471410441b91 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1362 microversion: 2.1 time: 0.216654 Oct 03 12:50:21.313460 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 63/116] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:21 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:21.370497 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-fdce37ad-8a1c-47bd-8e0a-8079a81b3dab tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:21.386343 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-fdce37ad-8a1c-47bd-8e0a-8079a81b3dab tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 0.248139 Oct 03 12:50:21.387084 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 54/117] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:21 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:21.631840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-34b69949-d166-4608-94d1-695bf7451a1e req-bccbf35e-0c57-4537-b915-5cf862de88ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a980d091-a942-46bc-a139-d12f9e2167ed", "name": "network-vif-plugged", "status": "completed", "tag": "b6c921d4-a92a-4c27-89cc-adf792fee725"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:50:21.642386 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-34b69949-d166-4608-94d1-695bf7451a1e req-bccbf35e-0c57-4537-b915-5cf862de88ba service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:21.643037 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-34b69949-d166-4608-94d1-695bf7451a1e req-bccbf35e-0c57-4537-b915-5cf862de88ba service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:21.645907 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-34b69949-d166-4608-94d1-695bf7451a1e req-bccbf35e-0c57-4537-b915-5cf862de88ba service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:21.655079 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-34b69949-d166-4608-94d1-695bf7451a1e req-bccbf35e-0c57-4537-b915-5cf862de88ba service nova] Creating event network-vif-plugged:b6c921d4-a92a-4c27-89cc-adf792fee725 for instance a980d091-a942-46bc-a139-d12f9e2167ed on hv-cinder-84456 Oct 03 12:50:21.660134 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-34b69949-d166-4608-94d1-695bf7451a1e req-bccbf35e-0c57-4537-b915-5cf862de88ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033669 Oct 03 12:50:21.660718 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 64/118] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:50:22.116055 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-6643c467-c277-4b06-89d6-82a4abb570a6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:22.116671 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-6643c467-c277-4b06-89d6-82a4abb570a6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:22.123420 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6643c467-c277-4b06-89d6-82a4abb570a6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:22.127124 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6643c467-c277-4b06-89d6-82a4abb570a6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:22.127124 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6643c467-c277-4b06-89d6-82a4abb570a6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:22.127124 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6643c467-c277-4b06-89d6-82a4abb570a6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:22.127124 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6643c467-c277-4b06-89d6-82a4abb570a6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:22.127461 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6643c467-c277-4b06-89d6-82a4abb570a6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:22.150400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-35631bef-1685-491e-8ea8-b3aabff6961d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:22.150400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-35631bef-1685-491e-8ea8-b3aabff6961d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:22.154770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-35631bef-1685-491e-8ea8-b3aabff6961d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:22.155262 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-35631bef-1685-491e-8ea8-b3aabff6961d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:22.155869 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-35631bef-1685-491e-8ea8-b3aabff6961d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:22.156569 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-35631bef-1685-491e-8ea8-b3aabff6961d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:22.157219 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-35631bef-1685-491e-8ea8-b3aabff6961d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:22.157863 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-35631bef-1685-491e-8ea8-b3aabff6961d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:22.346824 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-6643c467-c277-4b06-89d6-82a4abb570a6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:22.351657 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-35631bef-1685-491e-8ea8-b3aabff6961d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:22.355423 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-6643c467-c277-4b06-89d6-82a4abb570a6 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 0.243743 Oct 03 12:50:22.355990 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 55/119] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:22 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:22.365477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-35631bef-1685-491e-8ea8-b3aabff6961d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:22.365658 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e63602b7-96d7-47d1-871d-4e68188adbcf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:22.365658 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-e63602b7-96d7-47d1-871d-4e68188adbcf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:22.365835 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-35631bef-1685-491e-8ea8-b3aabff6961d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:22.365835 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-35631bef-1685-491e-8ea8-b3aabff6961d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.220416 Oct 03 12:50:22.365835 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 65/120] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:22 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:50:22.367763 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e63602b7-96d7-47d1-871d-4e68188adbcf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:22.368250 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e63602b7-96d7-47d1-871d-4e68188adbcf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:22.368690 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e63602b7-96d7-47d1-871d-4e68188adbcf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:22.369383 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e63602b7-96d7-47d1-871d-4e68188adbcf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:22.369834 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e63602b7-96d7-47d1-871d-4e68188adbcf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:22.370257 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e63602b7-96d7-47d1-871d-4e68188adbcf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:22.412148 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-52e87ac1-237d-4a3e-b8b4-27d050e9ea6a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:22.414631 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-52e87ac1-237d-4a3e-b8b4-27d050e9ea6a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:22.421913 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-52e87ac1-237d-4a3e-b8b4-27d050e9ea6a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:22.422517 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-52e87ac1-237d-4a3e-b8b4-27d050e9ea6a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:22.423198 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-52e87ac1-237d-4a3e-b8b4-27d050e9ea6a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:22.424421 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-52e87ac1-237d-4a3e-b8b4-27d050e9ea6a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:22.425217 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-52e87ac1-237d-4a3e-b8b4-27d050e9ea6a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:22.426022 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-52e87ac1-237d-4a3e-b8b4-27d050e9ea6a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:22.554105 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e63602b7-96d7-47d1-871d-4e68188adbcf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:22.561675 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e63602b7-96d7-47d1-871d-4e68188adbcf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1362 microversion: 2.1 time: 0.204652 Oct 03 12:50:22.562443 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 56/121] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:22 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:22.658650 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-52e87ac1-237d-4a3e-b8b4-27d050e9ea6a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:22.669839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-52e87ac1-237d-4a3e-b8b4-27d050e9ea6a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1321 microversion: 2.1 time: 0.259660 Oct 03 12:50:22.669839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 66/122] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:22 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:23.381928 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-7edf94a7-2f98-4b35-9287-9141360c96fb tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:23.383593 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-7edf94a7-2f98-4b35-9287-9141360c96fb tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:23.390057 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4376f17f-5ae9-45f3-b8b9-1f7d4a665bc0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:23.391097 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7edf94a7-2f98-4b35-9287-9141360c96fb tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:23.391288 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-4376f17f-5ae9-45f3-b8b9-1f7d4a665bc0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:23.391913 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7edf94a7-2f98-4b35-9287-9141360c96fb tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:23.392532 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7edf94a7-2f98-4b35-9287-9141360c96fb tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:23.393240 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7edf94a7-2f98-4b35-9287-9141360c96fb tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:23.394053 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7edf94a7-2f98-4b35-9287-9141360c96fb tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:23.395983 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7edf94a7-2f98-4b35-9287-9141360c96fb tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:23.401462 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4376f17f-5ae9-45f3-b8b9-1f7d4a665bc0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:23.402192 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4376f17f-5ae9-45f3-b8b9-1f7d4a665bc0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:23.402693 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4376f17f-5ae9-45f3-b8b9-1f7d4a665bc0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:23.403556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4376f17f-5ae9-45f3-b8b9-1f7d4a665bc0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:23.404076 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4376f17f-5ae9-45f3-b8b9-1f7d4a665bc0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:23.404504 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4376f17f-5ae9-45f3-b8b9-1f7d4a665bc0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:23.647164 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4376f17f-5ae9-45f3-b8b9-1f7d4a665bc0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:23.657717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4376f17f-5ae9-45f3-b8b9-1f7d4a665bc0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:23.658261 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7edf94a7-2f98-4b35-9287-9141360c96fb tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:23.661720 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4376f17f-5ae9-45f3-b8b9-1f7d4a665bc0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:23.664075 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-4376f17f-5ae9-45f3-b8b9-1f7d4a665bc0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.280114 Oct 03 12:50:23.668103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-7edf94a7-2f98-4b35-9287-9141360c96fb tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1315 microversion: 2.1 time: 0.291483 Oct 03 12:50:23.683783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 57/123] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:23 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:23.687405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 67/124] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:23 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:50:23.689670 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-1fcaf0b1-1ba7-4ce8-8c2f-1d2d8ae3f0c8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:23.690290 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-1fcaf0b1-1ba7-4ce8-8c2f-1d2d8ae3f0c8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:23.693525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c54cda1d-44e0-4b3f-9629-86e6396e904c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:23.694154 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c54cda1d-44e0-4b3f-9629-86e6396e904c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:23.697571 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1fcaf0b1-1ba7-4ce8-8c2f-1d2d8ae3f0c8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:23.698117 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1fcaf0b1-1ba7-4ce8-8c2f-1d2d8ae3f0c8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:23.698565 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1fcaf0b1-1ba7-4ce8-8c2f-1d2d8ae3f0c8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:23.699281 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1fcaf0b1-1ba7-4ce8-8c2f-1d2d8ae3f0c8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:23.699772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1fcaf0b1-1ba7-4ce8-8c2f-1d2d8ae3f0c8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:23.700195 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1fcaf0b1-1ba7-4ce8-8c2f-1d2d8ae3f0c8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:23.700872 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c54cda1d-44e0-4b3f-9629-86e6396e904c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:23.701512 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c54cda1d-44e0-4b3f-9629-86e6396e904c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:23.702114 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c54cda1d-44e0-4b3f-9629-86e6396e904c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:23.702986 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c54cda1d-44e0-4b3f-9629-86e6396e904c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:23.703660 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c54cda1d-44e0-4b3f-9629-86e6396e904c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:23.704190 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c54cda1d-44e0-4b3f-9629-86e6396e904c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:23.899878 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-1fcaf0b1-1ba7-4ce8-8c2f-1d2d8ae3f0c8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:23.907460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-1fcaf0b1-1ba7-4ce8-8c2f-1d2d8ae3f0c8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1362 microversion: 2.1 time: 0.222326 Oct 03 12:50:23.908029 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 58/125] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:23 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:23.908228 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c54cda1d-44e0-4b3f-9629-86e6396e904c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:23.917488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c54cda1d-44e0-4b3f-9629-86e6396e904c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1515 microversion: 2.1 time: 0.228968 Oct 03 12:50:23.929270 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 68/126] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:23 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:23.942937 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c835e696-7944-4285-b44e-98baac70ae81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:50:23.946361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-c835e696-7944-4285-b44e-98baac70ae81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:23.955934 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c835e696-7944-4285-b44e-98baac70ae81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:23.956726 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c835e696-7944-4285-b44e-98baac70ae81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:23.957434 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c835e696-7944-4285-b44e-98baac70ae81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:23.961294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c835e696-7944-4285-b44e-98baac70ae81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:23.961294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c835e696-7944-4285-b44e-98baac70ae81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:23.961294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c835e696-7944-4285-b44e-98baac70ae81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:24.046236 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-c835e696-7944-4285-b44e-98baac70ae81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lazy-loading 'flavor' on Instance uuid 89c20240-a307-4c2f-8121-6150803fef0c {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:50:24.596120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:24.631051 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c835e696-7944-4285-b44e-98baac70ae81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "POST /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c/action" status: 200 len: 32 microversion: 2.1 time: 0.694389 Oct 03 12:50:24.632266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 59/127] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 12:50:23 2022] POST /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c/action => generated 32 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 12:50:24.641604 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-17fbc903-f67e-49cc-944a-0e8e7499e659 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:24.642547 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-17fbc903-f67e-49cc-944a-0e8e7499e659 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:24.649435 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-17fbc903-f67e-49cc-944a-0e8e7499e659 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:24.649996 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-17fbc903-f67e-49cc-944a-0e8e7499e659 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:24.650435 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-17fbc903-f67e-49cc-944a-0e8e7499e659 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:24.651123 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-17fbc903-f67e-49cc-944a-0e8e7499e659 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:24.651603 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-17fbc903-f67e-49cc-944a-0e8e7499e659 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:24.652026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-17fbc903-f67e-49cc-944a-0e8e7499e659 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:24.690601 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-7067ef80-0210-42a0-84bd-67f76e78abc4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:24.691909 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-7067ef80-0210-42a0-84bd-67f76e78abc4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:24.698486 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7067ef80-0210-42a0-84bd-67f76e78abc4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:24.702241 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7067ef80-0210-42a0-84bd-67f76e78abc4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:24.702241 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7067ef80-0210-42a0-84bd-67f76e78abc4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:24.702241 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7067ef80-0210-42a0-84bd-67f76e78abc4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:24.702241 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7067ef80-0210-42a0-84bd-67f76e78abc4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:24.702614 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7067ef80-0210-42a0-84bd-67f76e78abc4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:24.927815 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-17fbc903-f67e-49cc-944a-0e8e7499e659 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:24.935644 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-17fbc903-f67e-49cc-944a-0e8e7499e659 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.297886 Oct 03 12:50:24.937047 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 69/128] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:24 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:24.944319 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d28d802f-f213-43dc-b6e5-edcb0235a28c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:24.945213 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d28d802f-f213-43dc-b6e5-edcb0235a28c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:24.951953 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d28d802f-f213-43dc-b6e5-edcb0235a28c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:24.955743 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7067ef80-0210-42a0-84bd-67f76e78abc4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:24.959956 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d28d802f-f213-43dc-b6e5-edcb0235a28c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:24.960431 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d28d802f-f213-43dc-b6e5-edcb0235a28c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:24.963081 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d28d802f-f213-43dc-b6e5-edcb0235a28c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:24.963573 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d28d802f-f213-43dc-b6e5-edcb0235a28c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:24.964066 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d28d802f-f213-43dc-b6e5-edcb0235a28c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:24.965514 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7067ef80-0210-42a0-84bd-67f76e78abc4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:24.966952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7067ef80-0210-42a0-84bd-67f76e78abc4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:24.968084 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-7067ef80-0210-42a0-84bd-67f76e78abc4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.281762 Oct 03 12:50:24.968640 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 60/129] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:24 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:50:24.973294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b41f734b-c52b-4aab-bd1c-87357bcc9c82 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:24.976906 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-b41f734b-c52b-4aab-bd1c-87357bcc9c82 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:24.979695 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b41f734b-c52b-4aab-bd1c-87357bcc9c82 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:24.980170 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b41f734b-c52b-4aab-bd1c-87357bcc9c82 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:24.980604 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b41f734b-c52b-4aab-bd1c-87357bcc9c82 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:24.981285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b41f734b-c52b-4aab-bd1c-87357bcc9c82 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:24.981734 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b41f734b-c52b-4aab-bd1c-87357bcc9c82 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:24.982153 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b41f734b-c52b-4aab-bd1c-87357bcc9c82 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:25.201949 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d28d802f-f213-43dc-b6e5-edcb0235a28c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:25.214261 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-b41f734b-c52b-4aab-bd1c-87357bcc9c82 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:25.219217 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d28d802f-f213-43dc-b6e5-edcb0235a28c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1502 microversion: 2.1 time: 0.280944 Oct 03 12:50:25.222372 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-b41f734b-c52b-4aab-bd1c-87357bcc9c82 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1362 microversion: 2.1 time: 0.252683 Oct 03 12:50:25.223144 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 61/131] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:24 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:25.223926 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 70/131] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:24 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1502 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:25.964705 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-66494462-a6fd-4aaf-afbd-57246ec19bd1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:25.965314 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-66494462-a6fd-4aaf-afbd-57246ec19bd1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:25.971583 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-66494462-a6fd-4aaf-afbd-57246ec19bd1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:25.972137 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-66494462-a6fd-4aaf-afbd-57246ec19bd1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:25.973343 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-66494462-a6fd-4aaf-afbd-57246ec19bd1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:25.974038 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-66494462-a6fd-4aaf-afbd-57246ec19bd1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:25.974488 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-66494462-a6fd-4aaf-afbd-57246ec19bd1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:25.974906 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-66494462-a6fd-4aaf-afbd-57246ec19bd1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:25.994085 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-cc028a20-1d85-4d9e-8543-5b304be1f098 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:25.994709 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-cc028a20-1d85-4d9e-8543-5b304be1f098 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:26.001024 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc028a20-1d85-4d9e-8543-5b304be1f098 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:26.001519 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc028a20-1d85-4d9e-8543-5b304be1f098 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:26.001959 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc028a20-1d85-4d9e-8543-5b304be1f098 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:26.002694 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc028a20-1d85-4d9e-8543-5b304be1f098 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:26.003157 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc028a20-1d85-4d9e-8543-5b304be1f098 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:26.003797 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc028a20-1d85-4d9e-8543-5b304be1f098 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:26.211777 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-66494462-a6fd-4aaf-afbd-57246ec19bd1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:26.221386 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-66494462-a6fd-4aaf-afbd-57246ec19bd1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.262579 Oct 03 12:50:26.223748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 62/132] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:25 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:26.248992 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-cc028a20-1d85-4d9e-8543-5b304be1f098 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:26.260791 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bb7cab2d-6cab-475a-bbee-ffff58c3db98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:26.261551 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-bb7cab2d-6cab-475a-bbee-ffff58c3db98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:26.267731 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb7cab2d-6cab-475a-bbee-ffff58c3db98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:26.268219 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb7cab2d-6cab-475a-bbee-ffff58c3db98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:26.268651 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb7cab2d-6cab-475a-bbee-ffff58c3db98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:26.270182 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb7cab2d-6cab-475a-bbee-ffff58c3db98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:26.270814 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb7cab2d-6cab-475a-bbee-ffff58c3db98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:26.271452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb7cab2d-6cab-475a-bbee-ffff58c3db98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:26.277917 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-cc028a20-1d85-4d9e-8543-5b304be1f098 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:26.279513 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-cc028a20-1d85-4d9e-8543-5b304be1f098 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:26.281167 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-cc028a20-1d85-4d9e-8543-5b304be1f098 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.291001 Oct 03 12:50:26.281734 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 71/133] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:25 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:50:26.421894 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-bb7cab2d-6cab-475a-bbee-ffff58c3db98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:26.433107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-bb7cab2d-6cab-475a-bbee-ffff58c3db98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1362 microversion: 2.1 time: 0.176338 Oct 03 12:50:26.433680 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 63/134] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:26 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:26.967774 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d8ebefd1-05d8-49d4-85d4-2333c9345d26 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e81fa1ea-373f-48cf-b8b8-7d68c765ea20"}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:50:26.973322 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d8ebefd1-05d8-49d4-85d4-2333c9345d26 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:26.977114 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d8ebefd1-05d8-49d4-85d4-2333c9345d26 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:26.977777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d8ebefd1-05d8-49d4-85d4-2333c9345d26 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:26.978213 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d8ebefd1-05d8-49d4-85d4-2333c9345d26 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:26.978942 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d8ebefd1-05d8-49d4-85d4-2333c9345d26 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:26.979422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d8ebefd1-05d8-49d4-85d4-2333c9345d26 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:26.979845 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d8ebefd1-05d8-49d4-85d4-2333c9345d26 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:27.247637 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-5f83ddca-14cd-47a8-8c2a-d0c69a44ff7c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:27.248263 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-5f83ddca-14cd-47a8-8c2a-d0c69a44ff7c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:27.259733 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5f83ddca-14cd-47a8-8c2a-d0c69a44ff7c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:27.260176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5f83ddca-14cd-47a8-8c2a-d0c69a44ff7c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:27.260622 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5f83ddca-14cd-47a8-8c2a-d0c69a44ff7c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:27.263684 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5f83ddca-14cd-47a8-8c2a-d0c69a44ff7c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:27.264339 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5f83ddca-14cd-47a8-8c2a-d0c69a44ff7c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:27.264793 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5f83ddca-14cd-47a8-8c2a-d0c69a44ff7c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:27.488603 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5f83ddca-14cd-47a8-8c2a-d0c69a44ff7c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:27.496003 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-5f83ddca-14cd-47a8-8c2a-d0c69a44ff7c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.252333 Oct 03 12:50:27.522583 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 64/135] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:27 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:27.522583 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ff3d0b8d-847d-4901-a126-33cfda9deb04 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:27.522583 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ff3d0b8d-847d-4901-a126-33cfda9deb04 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:27.525115 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff3d0b8d-847d-4901-a126-33cfda9deb04 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:27.525948 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff3d0b8d-847d-4901-a126-33cfda9deb04 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:27.526550 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff3d0b8d-847d-4901-a126-33cfda9deb04 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:27.528754 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff3d0b8d-847d-4901-a126-33cfda9deb04 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:27.529366 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff3d0b8d-847d-4901-a126-33cfda9deb04 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:27.529942 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff3d0b8d-847d-4901-a126-33cfda9deb04 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:27.803727 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-ff3d0b8d-847d-4901-a126-33cfda9deb04 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:27.804945 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-ff3d0b8d-847d-4901-a126-33cfda9deb04 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:27.806643 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-ff3d0b8d-847d-4901-a126-33cfda9deb04 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:27.808032 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ff3d0b8d-847d-4901-a126-33cfda9deb04 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.295711 Oct 03 12:50:27.808595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 65/136] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:27 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:50:27.813496 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-aa45d58e-c9e3-445e-94a6-751ff5ec0d0f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:27.814110 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-aa45d58e-c9e3-445e-94a6-751ff5ec0d0f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:27.820870 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-aa45d58e-c9e3-445e-94a6-751ff5ec0d0f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:27.825423 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-aa45d58e-c9e3-445e-94a6-751ff5ec0d0f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:27.825423 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-aa45d58e-c9e3-445e-94a6-751ff5ec0d0f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:27.825423 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-aa45d58e-c9e3-445e-94a6-751ff5ec0d0f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:27.825423 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-aa45d58e-c9e3-445e-94a6-751ff5ec0d0f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:27.825802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-aa45d58e-c9e3-445e-94a6-751ff5ec0d0f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:27.975498 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-aa45d58e-c9e3-445e-94a6-751ff5ec0d0f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:27.997606 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-aa45d58e-c9e3-445e-94a6-751ff5ec0d0f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1362 microversion: 2.1 time: 0.187936 Oct 03 12:50:27.998211 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 66/137] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:27 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:28.519337 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-55204ede-3868-438c-804e-c9c93851799f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:28.519988 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-55204ede-3868-438c-804e-c9c93851799f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:28.526006 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-55204ede-3868-438c-804e-c9c93851799f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:28.533023 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-55204ede-3868-438c-804e-c9c93851799f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:28.533023 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-55204ede-3868-438c-804e-c9c93851799f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:28.533023 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-55204ede-3868-438c-804e-c9c93851799f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:28.533023 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-55204ede-3868-438c-804e-c9c93851799f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:28.533476 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-55204ede-3868-438c-804e-c9c93851799f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:28.679003 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-55204ede-3868-438c-804e-c9c93851799f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:28.690728 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-55204ede-3868-438c-804e-c9c93851799f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.175929 Oct 03 12:50:28.695377 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 67/138] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:28 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:28.837808 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-77f7f30d-f9f5-467c-89ff-1566752e8901 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:28.838764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-77f7f30d-f9f5-467c-89ff-1566752e8901 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:28.848323 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-77f7f30d-f9f5-467c-89ff-1566752e8901 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:28.849085 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-77f7f30d-f9f5-467c-89ff-1566752e8901 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:28.849725 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-77f7f30d-f9f5-467c-89ff-1566752e8901 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:28.850771 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-77f7f30d-f9f5-467c-89ff-1566752e8901 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:28.851239 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-77f7f30d-f9f5-467c-89ff-1566752e8901 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:28.851699 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-77f7f30d-f9f5-467c-89ff-1566752e8901 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:29.026932 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-77f7f30d-f9f5-467c-89ff-1566752e8901 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:29.041743 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-77f7f30d-f9f5-467c-89ff-1566752e8901 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:29.043792 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-77f7f30d-f9f5-467c-89ff-1566752e8901 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:29.045429 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-77f7f30d-f9f5-467c-89ff-1566752e8901 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.213530 Oct 03 12:50:29.047606 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 68/139] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:28 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:50:29.073157 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8867524c-22fb-41ca-9793-16a6cb463c10 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:29.073774 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8867524c-22fb-41ca-9793-16a6cb463c10 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:29.079659 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8867524c-22fb-41ca-9793-16a6cb463c10 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:29.080150 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8867524c-22fb-41ca-9793-16a6cb463c10 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:29.080588 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8867524c-22fb-41ca-9793-16a6cb463c10 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:29.081284 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8867524c-22fb-41ca-9793-16a6cb463c10 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:29.082805 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8867524c-22fb-41ca-9793-16a6cb463c10 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:29.083416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8867524c-22fb-41ca-9793-16a6cb463c10 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:29.224141 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8867524c-22fb-41ca-9793-16a6cb463c10 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:29.231998 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-8867524c-22fb-41ca-9793-16a6cb463c10 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1362 microversion: 2.1 time: 0.163931 Oct 03 12:50:29.232787 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 69/140] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:29 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:29.283958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d8ebefd1-05d8-49d4-85d4-2333c9345d26 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "POST /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.320018 Oct 03 12:50:29.286974 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 72/141] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 12:50:26 2022] POST /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9/os-volume_attachments => generated 194 bytes in 2323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:50:29.629013 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-c8d824bd-b18c-4f33-a123-b767d8ad04c7 req-ad9eef50-834f-492d-9dfa-0c0171dcdf4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54982238-81ba-4d23-b642-e3a37f778b4a", "name": "network-vif-plugged", "status": "completed", "tag": "e846a01d-6972-40c0-b292-bc930ec8ca6d"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:50:29.640619 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-c8d824bd-b18c-4f33-a123-b767d8ad04c7 req-ad9eef50-834f-492d-9dfa-0c0171dcdf4a service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:29.641170 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-c8d824bd-b18c-4f33-a123-b767d8ad04c7 req-ad9eef50-834f-492d-9dfa-0c0171dcdf4a service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:29.641744 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-c8d824bd-b18c-4f33-a123-b767d8ad04c7 req-ad9eef50-834f-492d-9dfa-0c0171dcdf4a service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:29.654409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-c8d824bd-b18c-4f33-a123-b767d8ad04c7 req-ad9eef50-834f-492d-9dfa-0c0171dcdf4a service nova] Creating event network-vif-plugged:e846a01d-6972-40c0-b292-bc930ec8ca6d for instance 54982238-81ba-4d23-b642-e3a37f778b4a on hv-cinder-84456 Oct 03 12:50:29.660092 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-c8d824bd-b18c-4f33-a123-b767d8ad04c7 req-ad9eef50-834f-492d-9dfa-0c0171dcdf4a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034532 Oct 03 12:50:29.660726 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 70/142] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:50:29.717581 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-433bc9d1-2518-4c5c-98ff-ce0f7a1f921a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:29.718136 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-433bc9d1-2518-4c5c-98ff-ce0f7a1f921a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:29.725358 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-433bc9d1-2518-4c5c-98ff-ce0f7a1f921a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:29.726283 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-433bc9d1-2518-4c5c-98ff-ce0f7a1f921a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:29.726616 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-433bc9d1-2518-4c5c-98ff-ce0f7a1f921a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:29.727504 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-433bc9d1-2518-4c5c-98ff-ce0f7a1f921a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:29.727968 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-433bc9d1-2518-4c5c-98ff-ce0f7a1f921a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:29.728569 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-433bc9d1-2518-4c5c-98ff-ce0f7a1f921a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:29.914225 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-433bc9d1-2518-4c5c-98ff-ce0f7a1f921a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:29.922655 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-433bc9d1-2518-4c5c-98ff-ce0f7a1f921a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.209984 Oct 03 12:50:29.935754 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 73/143] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:29 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:30.074772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-705d2f8a-8673-4716-9f77-94f414a48196 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:30.075538 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-705d2f8a-8673-4716-9f77-94f414a48196 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:30.082508 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-705d2f8a-8673-4716-9f77-94f414a48196 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:30.083049 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-705d2f8a-8673-4716-9f77-94f414a48196 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:30.083518 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-705d2f8a-8673-4716-9f77-94f414a48196 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:30.084252 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-705d2f8a-8673-4716-9f77-94f414a48196 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:30.084704 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-705d2f8a-8673-4716-9f77-94f414a48196 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:30.086771 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-705d2f8a-8673-4716-9f77-94f414a48196 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:30.230655 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-705d2f8a-8673-4716-9f77-94f414a48196 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:30.246844 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-705d2f8a-8673-4716-9f77-94f414a48196 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:30.247887 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-705d2f8a-8673-4716-9f77-94f414a48196 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:30.249390 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-705d2f8a-8673-4716-9f77-94f414a48196 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.179708 Oct 03 12:50:30.251008 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 71/144] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:30 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:50:30.255903 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b4b0375c-eb95-473d-af80-687895b3e93a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:30.257445 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b4b0375c-eb95-473d-af80-687895b3e93a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:30.264503 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4b0375c-eb95-473d-af80-687895b3e93a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:30.265687 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4b0375c-eb95-473d-af80-687895b3e93a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:30.266324 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4b0375c-eb95-473d-af80-687895b3e93a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:30.267309 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4b0375c-eb95-473d-af80-687895b3e93a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:30.267969 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4b0375c-eb95-473d-af80-687895b3e93a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:30.268558 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4b0375c-eb95-473d-af80-687895b3e93a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:30.424941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-b4b0375c-eb95-473d-af80-687895b3e93a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:30.433136 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-b4b0375c-eb95-473d-af80-687895b3e93a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1549 microversion: 2.1 time: 0.181888 Oct 03 12:50:30.433714 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 74/145] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:30 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1549 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:30.455863 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-fc7b6ae8-b11f-46cf-be79-4c25d959bc83 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:30.456357 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-fc7b6ae8-b11f-46cf-be79-4c25d959bc83 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:30.463569 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fc7b6ae8-b11f-46cf-be79-4c25d959bc83 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:30.464065 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fc7b6ae8-b11f-46cf-be79-4c25d959bc83 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:30.464586 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fc7b6ae8-b11f-46cf-be79-4c25d959bc83 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:30.465296 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fc7b6ae8-b11f-46cf-be79-4c25d959bc83 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:30.465754 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fc7b6ae8-b11f-46cf-be79-4c25d959bc83 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:30.466182 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fc7b6ae8-b11f-46cf-be79-4c25d959bc83 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:30.566824 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-fc7b6ae8-b11f-46cf-be79-4c25d959bc83 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113918 Oct 03 12:50:30.567829 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 72/146] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Oct 3 12:50:30 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:50:30.949506 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-bc2e9e31-fd3f-4b4e-9ea7-1fb8bfbe1c7b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:30.950358 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-bc2e9e31-fd3f-4b4e-9ea7-1fb8bfbe1c7b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:30.957177 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bc2e9e31-fd3f-4b4e-9ea7-1fb8bfbe1c7b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:30.957658 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bc2e9e31-fd3f-4b4e-9ea7-1fb8bfbe1c7b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:30.958279 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bc2e9e31-fd3f-4b4e-9ea7-1fb8bfbe1c7b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:30.958977 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bc2e9e31-fd3f-4b4e-9ea7-1fb8bfbe1c7b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:30.959496 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bc2e9e31-fd3f-4b4e-9ea7-1fb8bfbe1c7b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:30.959926 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bc2e9e31-fd3f-4b4e-9ea7-1fb8bfbe1c7b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:31.104185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-bc2e9e31-fd3f-4b4e-9ea7-1fb8bfbe1c7b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:31.114029 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-bc2e9e31-fd3f-4b4e-9ea7-1fb8bfbe1c7b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.170332 Oct 03 12:50:31.114821 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 75/147] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:30 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:31.277868 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-cd6968b5-0f47-4195-9012-972974604311 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:31.283769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-cd6968b5-0f47-4195-9012-972974604311 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:31.285965 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cd6968b5-0f47-4195-9012-972974604311 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:31.286725 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cd6968b5-0f47-4195-9012-972974604311 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:31.287342 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cd6968b5-0f47-4195-9012-972974604311 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:31.288037 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cd6968b5-0f47-4195-9012-972974604311 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:31.288493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cd6968b5-0f47-4195-9012-972974604311 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:31.288912 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cd6968b5-0f47-4195-9012-972974604311 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:31.428236 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-cd6968b5-0f47-4195-9012-972974604311 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:31.453239 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-cd6968b5-0f47-4195-9012-972974604311 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:31.454684 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-cd6968b5-0f47-4195-9012-972974604311 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:31.455903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-cd6968b5-0f47-4195-9012-972974604311 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.181881 Oct 03 12:50:31.456462 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 73/148] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:31 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:50:31.988332 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-4e0cf933-bfa3-41bc-9e90-eaf59067e80c req-975374ab-c157-465b-9e1f-52a6ad1a653a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a980d091-a942-46bc-a139-d12f9e2167ed", "tag": "b6c921d4-a92a-4c27-89cc-adf792fee725"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:50:31.999557 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-4e0cf933-bfa3-41bc-9e90-eaf59067e80c req-975374ab-c157-465b-9e1f-52a6ad1a653a service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:32.000228 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-4e0cf933-bfa3-41bc-9e90-eaf59067e80c req-975374ab-c157-465b-9e1f-52a6ad1a653a service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:32.000662 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-4e0cf933-bfa3-41bc-9e90-eaf59067e80c req-975374ab-c157-465b-9e1f-52a6ad1a653a service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:32.012773 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-4e0cf933-bfa3-41bc-9e90-eaf59067e80c req-975374ab-c157-465b-9e1f-52a6ad1a653a service nova] Creating event network-changed:b6c921d4-a92a-4c27-89cc-adf792fee725 for instance a980d091-a942-46bc-a139-d12f9e2167ed on hv-cinder-84456 Oct 03 12:50:32.017677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-4e0cf933-bfa3-41bc-9e90-eaf59067e80c req-975374ab-c157-465b-9e1f-52a6ad1a653a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033432 Oct 03 12:50:32.018742 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 76/149] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:50:32.137419 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0a96acbf-a7e2-4091-96d1-3b1448d7ec38 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:32.138175 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-0a96acbf-a7e2-4091-96d1-3b1448d7ec38 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:32.145404 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a96acbf-a7e2-4091-96d1-3b1448d7ec38 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:32.146431 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a96acbf-a7e2-4091-96d1-3b1448d7ec38 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:32.146993 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a96acbf-a7e2-4091-96d1-3b1448d7ec38 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:32.148158 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a96acbf-a7e2-4091-96d1-3b1448d7ec38 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:32.148715 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a96acbf-a7e2-4091-96d1-3b1448d7ec38 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:32.149347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a96acbf-a7e2-4091-96d1-3b1448d7ec38 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:32.303080 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0a96acbf-a7e2-4091-96d1-3b1448d7ec38 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:32.309957 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0a96acbf-a7e2-4091-96d1-3b1448d7ec38 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.177332 Oct 03 12:50:32.310525 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 74/150] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:32 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:32.482148 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d2171202-cf32-4c5d-ae08-e54d075079fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:32.483078 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d2171202-cf32-4c5d-ae08-e54d075079fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:32.490261 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2171202-cf32-4c5d-ae08-e54d075079fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:32.490748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2171202-cf32-4c5d-ae08-e54d075079fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:32.491590 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2171202-cf32-4c5d-ae08-e54d075079fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:32.492284 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2171202-cf32-4c5d-ae08-e54d075079fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:32.493057 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2171202-cf32-4c5d-ae08-e54d075079fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:32.493488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2171202-cf32-4c5d-ae08-e54d075079fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:32.696787 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d2171202-cf32-4c5d-ae08-e54d075079fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:32.700362 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:32.706190 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d2171202-cf32-4c5d-ae08-e54d075079fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:32.708123 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d2171202-cf32-4c5d-ae08-e54d075079fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:32.711911 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d2171202-cf32-4c5d-ae08-e54d075079fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.231368 Oct 03 12:50:32.711911 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 77/151] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:32 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:50:33.333860 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-aff48fef-0831-4324-8c15-f69a29863a82 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:33.334491 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-aff48fef-0831-4324-8c15-f69a29863a82 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:33.340431 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-aff48fef-0831-4324-8c15-f69a29863a82 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:33.340918 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-aff48fef-0831-4324-8c15-f69a29863a82 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:33.341366 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-aff48fef-0831-4324-8c15-f69a29863a82 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:33.342238 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-aff48fef-0831-4324-8c15-f69a29863a82 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:33.342693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-aff48fef-0831-4324-8c15-f69a29863a82 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:33.343138 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-aff48fef-0831-4324-8c15-f69a29863a82 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:33.477683 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-aff48fef-0831-4324-8c15-f69a29863a82 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:33.485849 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-aff48fef-0831-4324-8c15-f69a29863a82 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.156403 Oct 03 12:50:33.486426 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 75/152] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:33 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:33.733735 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a4edd667-2114-42bd-8906-5439421fa56a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:33.734429 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a4edd667-2114-42bd-8906-5439421fa56a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:33.750508 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a4edd667-2114-42bd-8906-5439421fa56a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:33.752220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a4edd667-2114-42bd-8906-5439421fa56a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:33.765350 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a4edd667-2114-42bd-8906-5439421fa56a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:33.766368 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a4edd667-2114-42bd-8906-5439421fa56a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:33.766875 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a4edd667-2114-42bd-8906-5439421fa56a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:33.767217 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a4edd667-2114-42bd-8906-5439421fa56a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:33.993038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a4edd667-2114-42bd-8906-5439421fa56a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:34.006888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a4edd667-2114-42bd-8906-5439421fa56a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:34.008816 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a4edd667-2114-42bd-8906-5439421fa56a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:34.012212 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a4edd667-2114-42bd-8906-5439421fa56a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.282810 Oct 03 12:50:34.013133 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 78/153] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:33 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:50:34.510215 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-7dd15c84-98cd-46fc-8531-6cc58e0c793a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:34.511014 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-7dd15c84-98cd-46fc-8531-6cc58e0c793a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:34.517798 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7dd15c84-98cd-46fc-8531-6cc58e0c793a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:34.518387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7dd15c84-98cd-46fc-8531-6cc58e0c793a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:34.518711 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7dd15c84-98cd-46fc-8531-6cc58e0c793a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:34.520173 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7dd15c84-98cd-46fc-8531-6cc58e0c793a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:34.520671 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7dd15c84-98cd-46fc-8531-6cc58e0c793a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:34.521310 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7dd15c84-98cd-46fc-8531-6cc58e0c793a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:34.683054 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7dd15c84-98cd-46fc-8531-6cc58e0c793a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:34.694404 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-7dd15c84-98cd-46fc-8531-6cc58e0c793a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.188043 Oct 03 12:50:34.695680 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 76/154] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:34 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:35.040543 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e193f183-351f-4891-aa0c-d6aeeb320418 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:35.042447 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e193f183-351f-4891-aa0c-d6aeeb320418 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:35.052149 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e193f183-351f-4891-aa0c-d6aeeb320418 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:35.053466 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e193f183-351f-4891-aa0c-d6aeeb320418 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:35.054079 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e193f183-351f-4891-aa0c-d6aeeb320418 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:35.054972 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e193f183-351f-4891-aa0c-d6aeeb320418 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:35.055461 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e193f183-351f-4891-aa0c-d6aeeb320418 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:35.055927 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e193f183-351f-4891-aa0c-d6aeeb320418 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:35.198164 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e193f183-351f-4891-aa0c-d6aeeb320418 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:35.208652 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e193f183-351f-4891-aa0c-d6aeeb320418 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:35.210253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e193f183-351f-4891-aa0c-d6aeeb320418 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:35.211405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e193f183-351f-4891-aa0c-d6aeeb320418 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1407 microversion: 2.20 time: 0.178879 Oct 03 12:50:35.217873 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 79/155] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:35 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:50:35.725135 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3ca56733-46cb-480d-b0a9-cbce8167d819 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:35.725756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-3ca56733-46cb-480d-b0a9-cbce8167d819 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:35.732478 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3ca56733-46cb-480d-b0a9-cbce8167d819 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:35.732901 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3ca56733-46cb-480d-b0a9-cbce8167d819 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:35.733343 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3ca56733-46cb-480d-b0a9-cbce8167d819 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:35.734032 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3ca56733-46cb-480d-b0a9-cbce8167d819 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:35.734486 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3ca56733-46cb-480d-b0a9-cbce8167d819 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:35.734910 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3ca56733-46cb-480d-b0a9-cbce8167d819 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:35.751528 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:35.877196 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3ca56733-46cb-480d-b0a9-cbce8167d819 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:35.885718 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-3ca56733-46cb-480d-b0a9-cbce8167d819 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.164547 Oct 03 12:50:35.886336 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 77/156] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:35 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:36.236385 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-cc688e96-d8f0-4b10-985d-9758b9387d4f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:36.237174 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-cc688e96-d8f0-4b10-985d-9758b9387d4f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:36.244108 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc688e96-d8f0-4b10-985d-9758b9387d4f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:36.244599 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc688e96-d8f0-4b10-985d-9758b9387d4f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:36.245033 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc688e96-d8f0-4b10-985d-9758b9387d4f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:36.245726 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc688e96-d8f0-4b10-985d-9758b9387d4f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:36.246178 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc688e96-d8f0-4b10-985d-9758b9387d4f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:36.246597 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc688e96-d8f0-4b10-985d-9758b9387d4f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:36.386740 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-cc688e96-d8f0-4b10-985d-9758b9387d4f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:36.402262 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-cc688e96-d8f0-4b10-985d-9758b9387d4f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:36.404017 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-cc688e96-d8f0-4b10-985d-9758b9387d4f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:36.405465 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-cc688e96-d8f0-4b10-985d-9758b9387d4f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1599 microversion: 2.20 time: 0.172984 Oct 03 12:50:36.428321 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 80/157] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:50:36 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1599 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:50:36.447690 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-68c41951-4669-4dbf-b31a-3a2eec4a02b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:36.448566 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-68c41951-4669-4dbf-b31a-3a2eec4a02b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:36.456028 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=97 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:36.458506 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-68c41951-4669-4dbf-b31a-3a2eec4a02b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:36.459244 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-68c41951-4669-4dbf-b31a-3a2eec4a02b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:36.459929 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-68c41951-4669-4dbf-b31a-3a2eec4a02b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:36.461027 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-68c41951-4669-4dbf-b31a-3a2eec4a02b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:36.461523 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-68c41951-4669-4dbf-b31a-3a2eec4a02b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:36.461987 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-68c41951-4669-4dbf-b31a-3a2eec4a02b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:36.564881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-68c41951-4669-4dbf-b31a-3a2eec4a02b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.131605 Oct 03 12:50:36.565599 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 78/158] 10.222.0.33 () {60 vars in 1316 bytes} [Mon Oct 3 12:50:36 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:50:36.912415 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d3324fb8-0c81-4155-ba2a-97c605278f9a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:36.912415 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d3324fb8-0c81-4155-ba2a-97c605278f9a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:36.921956 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d3324fb8-0c81-4155-ba2a-97c605278f9a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:36.922924 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d3324fb8-0c81-4155-ba2a-97c605278f9a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:36.923840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d3324fb8-0c81-4155-ba2a-97c605278f9a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:36.925117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d3324fb8-0c81-4155-ba2a-97c605278f9a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:36.925756 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d3324fb8-0c81-4155-ba2a-97c605278f9a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:36.926500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d3324fb8-0c81-4155-ba2a-97c605278f9a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:37.315848 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d3324fb8-0c81-4155-ba2a-97c605278f9a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:37.326999 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d3324fb8-0c81-4155-ba2a-97c605278f9a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.421923 Oct 03 12:50:37.328873 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 81/159] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:36 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:38.307806 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-d4b347c4-fe8b-40c9-9e65-b06622694fa7 req-601f8594-0412-4024-a117-78fc2f528a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54982238-81ba-4d23-b642-e3a37f778b4a", "tag": "e846a01d-6972-40c0-b292-bc930ec8ca6d"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:50:38.321377 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-d4b347c4-fe8b-40c9-9e65-b06622694fa7 req-601f8594-0412-4024-a117-78fc2f528a18 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:38.324636 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-d4b347c4-fe8b-40c9-9e65-b06622694fa7 req-601f8594-0412-4024-a117-78fc2f528a18 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:38.324636 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-d4b347c4-fe8b-40c9-9e65-b06622694fa7 req-601f8594-0412-4024-a117-78fc2f528a18 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:38.337809 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-d4b347c4-fe8b-40c9-9e65-b06622694fa7 req-601f8594-0412-4024-a117-78fc2f528a18 service nova] Creating event network-changed:e846a01d-6972-40c0-b292-bc930ec8ca6d for instance 54982238-81ba-4d23-b642-e3a37f778b4a on hv-cinder-84456 Oct 03 12:50:38.343384 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-d4b347c4-fe8b-40c9-9e65-b06622694fa7 req-601f8594-0412-4024-a117-78fc2f528a18 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039866 Oct 03 12:50:38.344016 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 79/160] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:50:38.354352 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f291c6ef-b5d1-48b1-ab54-812e1ec00b87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:38.355698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f291c6ef-b5d1-48b1-ab54-812e1ec00b87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:38.358064 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=81 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:38.364545 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f291c6ef-b5d1-48b1-ab54-812e1ec00b87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:38.367015 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f291c6ef-b5d1-48b1-ab54-812e1ec00b87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:38.367521 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f291c6ef-b5d1-48b1-ab54-812e1ec00b87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:38.368274 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f291c6ef-b5d1-48b1-ab54-812e1ec00b87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:38.368835 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f291c6ef-b5d1-48b1-ab54-812e1ec00b87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:38.369292 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f291c6ef-b5d1-48b1-ab54-812e1ec00b87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:38.530949 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-f291c6ef-b5d1-48b1-ab54-812e1ec00b87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:38.540173 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f291c6ef-b5d1-48b1-ab54-812e1ec00b87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.189571 Oct 03 12:50:38.540768 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 82/161] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:38 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:39.565694 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-793ecf74-8fd6-4450-9cf1-6a6836c6ed03 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:39.566445 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-793ecf74-8fd6-4450-9cf1-6a6836c6ed03 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:39.572552 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-793ecf74-8fd6-4450-9cf1-6a6836c6ed03 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:39.573029 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-793ecf74-8fd6-4450-9cf1-6a6836c6ed03 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:39.573463 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-793ecf74-8fd6-4450-9cf1-6a6836c6ed03 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:39.574144 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-793ecf74-8fd6-4450-9cf1-6a6836c6ed03 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:39.574589 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-793ecf74-8fd6-4450-9cf1-6a6836c6ed03 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:39.575004 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-793ecf74-8fd6-4450-9cf1-6a6836c6ed03 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:39.707830 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-793ecf74-8fd6-4450-9cf1-6a6836c6ed03 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:39.715448 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-793ecf74-8fd6-4450-9cf1-6a6836c6ed03 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.153876 Oct 03 12:50:39.716013 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 80/162] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:39 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:40.739282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-094ddfe7-d0a8-4c2b-900c-39f38747c1c3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:40.739920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-094ddfe7-d0a8-4c2b-900c-39f38747c1c3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:40.746509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-094ddfe7-d0a8-4c2b-900c-39f38747c1c3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:40.746991 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-094ddfe7-d0a8-4c2b-900c-39f38747c1c3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:40.747455 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-094ddfe7-d0a8-4c2b-900c-39f38747c1c3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:40.748144 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-094ddfe7-d0a8-4c2b-900c-39f38747c1c3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:40.748600 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-094ddfe7-d0a8-4c2b-900c-39f38747c1c3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:40.749024 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-094ddfe7-d0a8-4c2b-900c-39f38747c1c3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:40.879199 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-094ddfe7-d0a8-4c2b-900c-39f38747c1c3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:40.886913 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-094ddfe7-d0a8-4c2b-900c-39f38747c1c3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.152370 Oct 03 12:50:40.887508 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 83/163] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:40 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:41.909993 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ecda5ad4-e113-46b5-a8bd-04e357a1a0d1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:41.910536 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ecda5ad4-e113-46b5-a8bd-04e357a1a0d1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:41.916639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ecda5ad4-e113-46b5-a8bd-04e357a1a0d1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:41.917123 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ecda5ad4-e113-46b5-a8bd-04e357a1a0d1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:41.917552 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ecda5ad4-e113-46b5-a8bd-04e357a1a0d1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:41.918239 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ecda5ad4-e113-46b5-a8bd-04e357a1a0d1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:41.918688 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ecda5ad4-e113-46b5-a8bd-04e357a1a0d1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:41.919104 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ecda5ad4-e113-46b5-a8bd-04e357a1a0d1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:42.045368 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-ecda5ad4-e113-46b5-a8bd-04e357a1a0d1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:42.053547 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ecda5ad4-e113-46b5-a8bd-04e357a1a0d1 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.147534 Oct 03 12:50:42.054106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 81/164] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:41 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:43.076772 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7995b7ff-18c4-4f6d-a35a-1a119445e18c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:43.077421 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-7995b7ff-18c4-4f6d-a35a-1a119445e18c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:43.084805 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7995b7ff-18c4-4f6d-a35a-1a119445e18c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:43.085292 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7995b7ff-18c4-4f6d-a35a-1a119445e18c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:43.085728 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7995b7ff-18c4-4f6d-a35a-1a119445e18c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:43.086418 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7995b7ff-18c4-4f6d-a35a-1a119445e18c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:43.086865 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7995b7ff-18c4-4f6d-a35a-1a119445e18c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:43.087283 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7995b7ff-18c4-4f6d-a35a-1a119445e18c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:43.241073 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-7995b7ff-18c4-4f6d-a35a-1a119445e18c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:43.249067 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-7995b7ff-18c4-4f6d-a35a-1a119445e18c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.176023 Oct 03 12:50:43.249648 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 84/165] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:43 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:44.272488 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-6cb6a13d-b241-4621-b029-960124464791 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:44.273175 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-6cb6a13d-b241-4621-b029-960124464791 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:44.279395 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6cb6a13d-b241-4621-b029-960124464791 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:44.279898 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6cb6a13d-b241-4621-b029-960124464791 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:44.280339 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6cb6a13d-b241-4621-b029-960124464791 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:44.281037 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6cb6a13d-b241-4621-b029-960124464791 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:44.281490 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6cb6a13d-b241-4621-b029-960124464791 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:44.281913 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6cb6a13d-b241-4621-b029-960124464791 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:44.415957 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-6cb6a13d-b241-4621-b029-960124464791 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:44.425315 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-6cb6a13d-b241-4621-b029-960124464791 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.157228 Oct 03 12:50:44.426456 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 82/166] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:44 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:45.451846 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c07acba1-9c0a-4e7a-b1f8-9686c0a943c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:45.452471 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c07acba1-9c0a-4e7a-b1f8-9686c0a943c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:45.459905 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c07acba1-9c0a-4e7a-b1f8-9686c0a943c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:45.460448 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c07acba1-9c0a-4e7a-b1f8-9686c0a943c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:45.460883 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c07acba1-9c0a-4e7a-b1f8-9686c0a943c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:45.461610 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c07acba1-9c0a-4e7a-b1f8-9686c0a943c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:45.462066 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c07acba1-9c0a-4e7a-b1f8-9686c0a943c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:45.462486 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c07acba1-9c0a-4e7a-b1f8-9686c0a943c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:45.614460 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c07acba1-9c0a-4e7a-b1f8-9686c0a943c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:45.622197 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c07acba1-9c0a-4e7a-b1f8-9686c0a943c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.174215 Oct 03 12:50:45.623348 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 85/167] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:45 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:46.655499 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-08ee246c-e623-46e5-93c8-f3e8b8976992 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:46.655499 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-08ee246c-e623-46e5-93c8-f3e8b8976992 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:46.655499 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-08ee246c-e623-46e5-93c8-f3e8b8976992 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:46.655499 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-08ee246c-e623-46e5-93c8-f3e8b8976992 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:46.656615 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-08ee246c-e623-46e5-93c8-f3e8b8976992 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:46.656615 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-08ee246c-e623-46e5-93c8-f3e8b8976992 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:46.656615 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-08ee246c-e623-46e5-93c8-f3e8b8976992 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:46.656615 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-08ee246c-e623-46e5-93c8-f3e8b8976992 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:46.742397 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b0c7478c-2b4c-413f-92de-20cd5f097f1c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:46.743190 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b0c7478c-2b4c-413f-92de-20cd5f097f1c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:46.750022 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b0c7478c-2b4c-413f-92de-20cd5f097f1c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:46.750976 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b0c7478c-2b4c-413f-92de-20cd5f097f1c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:46.750976 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b0c7478c-2b4c-413f-92de-20cd5f097f1c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:46.751879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b0c7478c-2b4c-413f-92de-20cd5f097f1c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:46.752346 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b0c7478c-2b4c-413f-92de-20cd5f097f1c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:46.752772 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b0c7478c-2b4c-413f-92de-20cd5f097f1c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:46.786044 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b0c7478c-2b4c-413f-92de-20cd5f097f1c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Going to try to terminate instance {{(pid=127542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:50:46.859053 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-08ee246c-e623-46e5-93c8-f3e8b8976992 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:46.866958 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-08ee246c-e623-46e5-93c8-f3e8b8976992 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.224736 Oct 03 12:50:46.867545 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 83/168] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:46 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:47.163809 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-b0c7478c-2b4c-413f-92de-20cd5f097f1c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 204 len: 0 microversion: 2.1 time: 0.427435 Oct 03 12:50:47.164668 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 86/169] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:50:46 2022] DELETE /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 12:50:47.173265 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-6ea109f7-c330-4e94-9631-072916299d8a tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:47.173884 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-6ea109f7-c330-4e94-9631-072916299d8a tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:47.180761 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6ea109f7-c330-4e94-9631-072916299d8a tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:47.181259 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6ea109f7-c330-4e94-9631-072916299d8a tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:47.181703 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6ea109f7-c330-4e94-9631-072916299d8a tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:47.182403 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6ea109f7-c330-4e94-9631-072916299d8a tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:47.182864 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6ea109f7-c330-4e94-9631-072916299d8a tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:47.183292 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6ea109f7-c330-4e94-9631-072916299d8a tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:47.331445 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-6ea109f7-c330-4e94-9631-072916299d8a tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:47.340657 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-6ea109f7-c330-4e94-9631-072916299d8a tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1554 microversion: 2.1 time: 0.171333 Oct 03 12:50:47.341444 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 84/170] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:47 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:47.895084 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8381115c-64dc-40b2-a697-fca56c737d1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:47.896522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8381115c-64dc-40b2-a697-fca56c737d1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:47.904272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8381115c-64dc-40b2-a697-fca56c737d1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:47.905132 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8381115c-64dc-40b2-a697-fca56c737d1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:47.907055 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8381115c-64dc-40b2-a697-fca56c737d1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:47.907055 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8381115c-64dc-40b2-a697-fca56c737d1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:47.907055 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8381115c-64dc-40b2-a697-fca56c737d1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:47.908032 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8381115c-64dc-40b2-a697-fca56c737d1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:48.068521 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8381115c-64dc-40b2-a697-fca56c737d1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:48.072795 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8381115c-64dc-40b2-a697-fca56c737d1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.186300 Oct 03 12:50:48.073362 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 87/171] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:47 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:48.362973 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bf989312-619b-4a05-a8b1-a287287cca48 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:48.364087 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-bf989312-619b-4a05-a8b1-a287287cca48 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:48.370031 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf989312-619b-4a05-a8b1-a287287cca48 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:48.370748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf989312-619b-4a05-a8b1-a287287cca48 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:48.371258 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf989312-619b-4a05-a8b1-a287287cca48 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:48.372070 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf989312-619b-4a05-a8b1-a287287cca48 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:48.372618 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf989312-619b-4a05-a8b1-a287287cca48 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:48.373115 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf989312-619b-4a05-a8b1-a287287cca48 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:48.512008 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-bf989312-619b-4a05-a8b1-a287287cca48 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:48.521181 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-bf989312-619b-4a05-a8b1-a287287cca48 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1554 microversion: 2.1 time: 0.162111 Oct 03 12:50:48.521820 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 85/172] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:48 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:49.096244 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-28f47b77-39ab-478b-8c76-fff194513115 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:49.096931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-28f47b77-39ab-478b-8c76-fff194513115 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:49.105149 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-28f47b77-39ab-478b-8c76-fff194513115 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:49.105673 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-28f47b77-39ab-478b-8c76-fff194513115 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:49.106175 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-28f47b77-39ab-478b-8c76-fff194513115 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:49.106994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-28f47b77-39ab-478b-8c76-fff194513115 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:49.107478 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-28f47b77-39ab-478b-8c76-fff194513115 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:49.108155 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-28f47b77-39ab-478b-8c76-fff194513115 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:49.319240 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-28f47b77-39ab-478b-8c76-fff194513115 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:49.328794 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-28f47b77-39ab-478b-8c76-fff194513115 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.236448 Oct 03 12:50:49.329378 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 88/173] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:49 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:49.547021 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-eb263b33-3d57-4681-9eb6-3b973862fecc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:49.548746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-eb263b33-3d57-4681-9eb6-3b973862fecc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:49.556090 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-eb263b33-3d57-4681-9eb6-3b973862fecc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:49.556580 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-eb263b33-3d57-4681-9eb6-3b973862fecc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:49.557017 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-eb263b33-3d57-4681-9eb6-3b973862fecc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:49.558507 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-eb263b33-3d57-4681-9eb6-3b973862fecc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:49.559201 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-eb263b33-3d57-4681-9eb6-3b973862fecc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:49.559902 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-eb263b33-3d57-4681-9eb6-3b973862fecc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:49.702086 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-eb263b33-3d57-4681-9eb6-3b973862fecc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:49.719394 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-eb263b33-3d57-4681-9eb6-3b973862fecc tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1554 microversion: 2.1 time: 0.178015 Oct 03 12:50:49.720197 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 86/174] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:49 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:50.354593 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-21e4d318-2d7c-4105-862e-27c60ac61515 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:50.355380 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-21e4d318-2d7c-4105-862e-27c60ac61515 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:50.361965 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21e4d318-2d7c-4105-862e-27c60ac61515 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:50.362464 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21e4d318-2d7c-4105-862e-27c60ac61515 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:50.362958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21e4d318-2d7c-4105-862e-27c60ac61515 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:50.363955 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21e4d318-2d7c-4105-862e-27c60ac61515 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:50.364436 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21e4d318-2d7c-4105-862e-27c60ac61515 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:50.364845 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21e4d318-2d7c-4105-862e-27c60ac61515 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:50.527920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-21e4d318-2d7c-4105-862e-27c60ac61515 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:50.546866 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-21e4d318-2d7c-4105-862e-27c60ac61515 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.196462 Oct 03 12:50:50.547480 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 89/175] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:50 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:50.728742 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-165b5871-88ea-45b8-814c-3b8bc3708830 req-6c44eba1-cd53-42a4-91af-b31fa5cbcfa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0723fe-401f-47ef-8b51-22dd148860e9", "name": "network-vif-deleted", "tag": "edee2177-f99c-4159-b115-94dfdb5803e0"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:50:50.744805 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b753855b-698f-4f9d-b66e-b5f3c248d618 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:50.746910 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b753855b-698f-4f9d-b66e-b5f3c248d618 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:50.753143 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b753855b-698f-4f9d-b66e-b5f3c248d618 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:50.754183 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b753855b-698f-4f9d-b66e-b5f3c248d618 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:50.754627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b753855b-698f-4f9d-b66e-b5f3c248d618 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:50.765335 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-165b5871-88ea-45b8-814c-3b8bc3708830 req-6c44eba1-cd53-42a4-91af-b31fa5cbcfa8 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:50.765335 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-165b5871-88ea-45b8-814c-3b8bc3708830 req-6c44eba1-cd53-42a4-91af-b31fa5cbcfa8 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:50.765335 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-165b5871-88ea-45b8-814c-3b8bc3708830 req-6c44eba1-cd53-42a4-91af-b31fa5cbcfa8 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:50.765843 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b753855b-698f-4f9d-b66e-b5f3c248d618 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:50.765843 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b753855b-698f-4f9d-b66e-b5f3c248d618 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:50.765843 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b753855b-698f-4f9d-b66e-b5f3c248d618 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:50.788119 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-165b5871-88ea-45b8-814c-3b8bc3708830 req-6c44eba1-cd53-42a4-91af-b31fa5cbcfa8 service nova] Creating event network-vif-deleted:edee2177-f99c-4159-b115-94dfdb5803e0 for instance ea0723fe-401f-47ef-8b51-22dd148860e9 on hv-cinder-84456 Oct 03 12:50:50.794681 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-165b5871-88ea-45b8-814c-3b8bc3708830 req-6c44eba1-cd53-42a4-91af-b31fa5cbcfa8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069667 Oct 03 12:50:50.833043 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 87/176] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:50:50.918748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-b753855b-698f-4f9d-b66e-b5f3c248d618 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:50.929641 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-b753855b-698f-4f9d-b66e-b5f3c248d618 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1512 microversion: 2.1 time: 0.188812 Oct 03 12:50:50.930218 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 90/177] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:50 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1512 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:51.573462 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c21d1a75-f82e-489d-a1ef-33b81eff39e7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:51.574640 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-c21d1a75-f82e-489d-a1ef-33b81eff39e7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:51.582391 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c21d1a75-f82e-489d-a1ef-33b81eff39e7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:51.583425 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c21d1a75-f82e-489d-a1ef-33b81eff39e7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:51.583827 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c21d1a75-f82e-489d-a1ef-33b81eff39e7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:51.584758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c21d1a75-f82e-489d-a1ef-33b81eff39e7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:51.585289 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c21d1a75-f82e-489d-a1ef-33b81eff39e7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:51.585789 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c21d1a75-f82e-489d-a1ef-33b81eff39e7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:51.953583 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-44aff270-b659-4867-b769-90d5522768e2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:51.955059 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-44aff270-b659-4867-b769-90d5522768e2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:51.962089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44aff270-b659-4867-b769-90d5522768e2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:51.962588 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44aff270-b659-4867-b769-90d5522768e2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:51.963198 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44aff270-b659-4867-b769-90d5522768e2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:51.963947 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44aff270-b659-4867-b769-90d5522768e2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:51.964437 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44aff270-b659-4867-b769-90d5522768e2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:51.964869 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44aff270-b659-4867-b769-90d5522768e2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:51.972479 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c21d1a75-f82e-489d-a1ef-33b81eff39e7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:51.980997 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c21d1a75-f82e-489d-a1ef-33b81eff39e7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.413109 Oct 03 12:50:51.982578 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 88/178] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:51 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:52.008021 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44aff270-b659-4867-b769-90d5522768e2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:52.008492 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44aff270-b659-4867-b769-90d5522768e2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:52.008930 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44aff270-b659-4867-b769-90d5522768e2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:52.009392 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-44aff270-b659-4867-b769-90d5522768e2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lazy-loading 'fault' on Instance uuid ea0723fe-401f-47ef-8b51-22dd148860e9 {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:50:52.098890 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-44aff270-b659-4867-b769-90d5522768e2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f938505064304ae19cd0a6df370b7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7994e24004a42ac88491cf70b3d1086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:52.111917 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-44aff270-b659-4867-b769-90d5522768e2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 200 len: 1351 microversion: 2.1 time: 0.162569 Oct 03 12:50:52.113480 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 91/179] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:51 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 1351 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:53.005845 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0897820b-1a14-4cd5-a250-8c10f810b5b6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:53.006819 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-0897820b-1a14-4cd5-a250-8c10f810b5b6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:53.012823 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0897820b-1a14-4cd5-a250-8c10f810b5b6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:53.013304 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0897820b-1a14-4cd5-a250-8c10f810b5b6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:53.013741 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0897820b-1a14-4cd5-a250-8c10f810b5b6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:53.014471 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0897820b-1a14-4cd5-a250-8c10f810b5b6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:53.014927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0897820b-1a14-4cd5-a250-8c10f810b5b6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:53.015558 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0897820b-1a14-4cd5-a250-8c10f810b5b6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:53.142993 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a362b66e-b45a-4260-975c-bedb073c84d2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:53.143860 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a362b66e-b45a-4260-975c-bedb073c84d2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:53.151225 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a362b66e-b45a-4260-975c-bedb073c84d2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:53.156973 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a362b66e-b45a-4260-975c-bedb073c84d2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:53.156973 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a362b66e-b45a-4260-975c-bedb073c84d2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:53.156973 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a362b66e-b45a-4260-975c-bedb073c84d2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:53.156973 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a362b66e-b45a-4260-975c-bedb073c84d2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:53.157268 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a362b66e-b45a-4260-975c-bedb073c84d2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:53.169265 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-a362b66e-b45a-4260-975c-bedb073c84d2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] HTTP exception thrown: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a362b66e-b45a-4260-975c-bedb073c84d2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Request method failure captured: Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 HTTP/1.1 Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtpixxALegGqBrXh7PXj3H9t0PlFruiVvWAFuUe0YtuNU1Fmzs4pv-Wkv7FdtPWiSarD2mWZHndZBHFxT9AkF1F5cWSXgwXjSHHp2bW6LiojFMVz6UaRkSpSfQeQItTSzn2M0VHiiLH-gaZZnJkik4_6ZR1TMQqF8M8gztDytFSC8s4 Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: d7994e24004a42ac88491cf70b3d1086 Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-DeleteServersTestJSON-633058460 Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:50:53.174536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:50:53.176474 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7994e24004a42ac88491cf70b3d1086"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7994e24004a42ac88491cf70b3d1086"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7994e24004a42ac88491cf70b3d1086"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7994e24004a42ac88491cf70b3d1086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:50:53.176474 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-DeleteServersTestJSON-633058460 Oct 03 12:50:53.176474 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: d7994e24004a42ac88491cf70b3d1086 Oct 03 12:50:53.176474 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-DeleteServersTestJSON-633058460 Oct 03 12:50:53.176474 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-DeleteServersTestJSON-633058460-project Oct 03 12:50:53.176474 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:50:53.176474 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:50:53.176474 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: f938505064304ae19cd0a6df370b7721 Oct 03 12:50:53.176474 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-DeleteServersTestJSON-633058460-project Oct 03 12:50:53.176474 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:50:53.176474 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:53.176474 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': 'ea0723fe-401f-47ef-8b51-22dd148860e9'} Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:50:53.177139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:53.178272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:50:53.179883 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a362b66e-b45a-4260-975c-bedb073c84d2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Returning 404 to user: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:50:53.179883 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a362b66e-b45a-4260-975c-bedb073c84d2 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 404 len: 111 microversion: 2.1 time: 0.040773 Oct 03 12:50:53.179883 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 92/180] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:53 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 12:50:53.184290 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0897820b-1a14-4cd5-a250-8c10f810b5b6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:53.188183 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0897820b-1a14-4cd5-a250-8c10f810b5b6 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.186146 Oct 03 12:50:53.188937 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 89/181] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:53 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:53.319228 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c4bca7f3-b677-4df0-af0f-0bbac66ec00c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:53.321615 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c4bca7f3-b677-4df0-af0f-0bbac66ec00c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:53.328074 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4bca7f3-b677-4df0-af0f-0bbac66ec00c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:53.328571 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4bca7f3-b677-4df0-af0f-0bbac66ec00c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:53.329202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4bca7f3-b677-4df0-af0f-0bbac66ec00c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:53.329927 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4bca7f3-b677-4df0-af0f-0bbac66ec00c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:53.330392 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4bca7f3-b677-4df0-af0f-0bbac66ec00c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:53.330824 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4bca7f3-b677-4df0-af0f-0bbac66ec00c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:53.336481 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:53.345997 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-c4bca7f3-b677-4df0-af0f-0bbac66ec00c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] HTTP exception thrown: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c4bca7f3-b677-4df0-af0f-0bbac66ec00c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Request method failure captured: Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9/os-volume_attachments HTTP/1.1 Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtpixxALegGqBrXh7PXj3H9t0PlFruiVvWAFuUe0YtuNU1Fmzs4pv-Wkv7FdtPWiSarD2mWZHndZBHFxT9AkF1F5cWSXgwXjSHHp2bW6LiojFMVz6UaRkSpSfQeQItTSzn2M0VHiiLH-gaZZnJkik4_6ZR1TMQqF8M8gztDytFSC8s4 Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: d7994e24004a42ac88491cf70b3d1086 Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-DeleteServersTestJSON-633058460 Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:50:53.347721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:50:53.349294 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7994e24004a42ac88491cf70b3d1086"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7994e24004a42ac88491cf70b3d1086"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7994e24004a42ac88491cf70b3d1086"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7994e24004a42ac88491cf70b3d1086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:50:53.349294 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-DeleteServersTestJSON-633058460 Oct 03 12:50:53.349294 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: d7994e24004a42ac88491cf70b3d1086 Oct 03 12:50:53.349294 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-DeleteServersTestJSON-633058460 Oct 03 12:50:53.349294 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-DeleteServersTestJSON-633058460-project Oct 03 12:50:53.349294 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:50:53.349294 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:50:53.349294 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: f938505064304ae19cd0a6df370b7721 Oct 03 12:50:53.349294 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-DeleteServersTestJSON-633058460-project Oct 03 12:50:53.349294 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:50:53.349294 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:53.349294 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'server_id': 'ea0723fe-401f-47ef-8b51-22dd148860e9'} Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:50:53.350106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:53.351359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:50:53.354083 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c4bca7f3-b677-4df0-af0f-0bbac66ec00c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Returning 404 to user: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:50:53.354083 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c4bca7f3-b677-4df0-af0f-0bbac66ec00c tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034642 Oct 03 12:50:53.354083 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 93/182] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 12:50:53 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:50:54.211939 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9dffd0c5-9f39-4df7-9274-44d5aecbac9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:54.212627 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-9dffd0c5-9f39-4df7-9274-44d5aecbac9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:54.219197 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9dffd0c5-9f39-4df7-9274-44d5aecbac9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:54.219709 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9dffd0c5-9f39-4df7-9274-44d5aecbac9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:54.220143 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9dffd0c5-9f39-4df7-9274-44d5aecbac9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:54.220863 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9dffd0c5-9f39-4df7-9274-44d5aecbac9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:54.221316 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9dffd0c5-9f39-4df7-9274-44d5aecbac9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:54.221734 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9dffd0c5-9f39-4df7-9274-44d5aecbac9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:54.362154 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9dffd0c5-9f39-4df7-9274-44d5aecbac9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:54.371010 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-9dffd0c5-9f39-4df7-9274-44d5aecbac9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.163142 Oct 03 12:50:54.383521 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 90/183] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:54 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:54.722836 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-435118251", "imageRef": "9d585789-e496-433d-b311-70ec7ceffd99", "flavorRef": "452", "networks": [{"uuid": "df9ed0db-b693-4022-818d-ff2821fbd347"}]}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:50:54.788524 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.network.neutron [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] validate_networks() for [('df9ed0db-b693-4022-818d-ff2821fbd347', None, None, None, None, None)] {{(pid=127542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:50:54.830554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-876e3dc2-713a-4522-8c44-341953c48010 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:54.832113 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-876e3dc2-713a-4522-8c44-341953c48010 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:54.840289 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-876e3dc2-713a-4522-8c44-341953c48010 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:54.842168 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-876e3dc2-713a-4522-8c44-341953c48010 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:54.842168 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-876e3dc2-713a-4522-8c44-341953c48010 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:54.842718 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-876e3dc2-713a-4522-8c44-341953c48010 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:54.843396 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-876e3dc2-713a-4522-8c44-341953c48010 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:54.844107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-876e3dc2-713a-4522-8c44-341953c48010 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:54.863865 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-876e3dc2-713a-4522-8c44-341953c48010 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] HTTP exception thrown: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-876e3dc2-713a-4522-8c44-341953c48010 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Request method failure captured: Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: DELETE /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 HTTP/1.1 Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtpixxALegGqBrXh7PXj3H9t0PlFruiVvWAFuUe0YtuNU1Fmzs4pv-Wkv7FdtPWiSarD2mWZHndZBHFxT9AkF1F5cWSXgwXjSHHp2bW6LiojFMVz6UaRkSpSfQeQItTSzn2M0VHiiLH-gaZZnJkik4_6ZR1TMQqF8M8gztDytFSC8s4 Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: d7994e24004a42ac88491cf70b3d1086 Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-DeleteServersTestJSON-633058460 Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 12:50:54.868841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 12:50:54.870134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7994e24004a42ac88491cf70b3d1086"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7994e24004a42ac88491cf70b3d1086"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7994e24004a42ac88491cf70b3d1086"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7994e24004a42ac88491cf70b3d1086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:50:54.870134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-DeleteServersTestJSON-633058460 Oct 03 12:50:54.870134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: d7994e24004a42ac88491cf70b3d1086 Oct 03 12:50:54.870134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-DeleteServersTestJSON-633058460 Oct 03 12:50:54.870134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-DeleteServersTestJSON-633058460-project Oct 03 12:50:54.870134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 12:50:54.870134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 12:50:54.870134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: f938505064304ae19cd0a6df370b7721 Oct 03 12:50:54.870134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-DeleteServersTestJSON-633058460-project Oct 03 12:50:54.870134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 12:50:54.870134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:54.870134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': 'ea0723fe-401f-47ef-8b51-22dd148860e9'} Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:50:54.870772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:54.871921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:50:54.872986 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-876e3dc2-713a-4522-8c44-341953c48010 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Returning 404 to user: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:50:54.872986 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-876e3dc2-713a-4522-8c44-341953c48010 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 404 len: 111 microversion: 2.1 time: 0.045049 Oct 03 12:50:54.872986 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 91/184] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:50:54 2022] DELETE /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 12:50:54.879672 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d1e7831c-f0df-4173-8f3a-ef7e4657a902 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:54.880283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d1e7831c-f0df-4173-8f3a-ef7e4657a902 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] [instance: ea0723fe-401f-47ef-8b51-22dd148860e9] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:54.886549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d1e7831c-f0df-4173-8f3a-ef7e4657a902 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:54.887717 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d1e7831c-f0df-4173-8f3a-ef7e4657a902 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:54.888300 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d1e7831c-f0df-4173-8f3a-ef7e4657a902 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:54.889150 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d1e7831c-f0df-4173-8f3a-ef7e4657a902 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:54.889800 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d1e7831c-f0df-4173-8f3a-ef7e4657a902 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:54.890364 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d1e7831c-f0df-4173-8f3a-ef7e4657a902 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:54.905566 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-d1e7831c-f0df-4173-8f3a-ef7e4657a902 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] HTTP exception thrown: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d1e7831c-f0df-4173-8f3a-ef7e4657a902 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Request method failure captured: Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 HTTP/1.1 Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtpixxALegGqBrXh7PXj3H9t0PlFruiVvWAFuUe0YtuNU1Fmzs4pv-Wkv7FdtPWiSarD2mWZHndZBHFxT9AkF1F5cWSXgwXjSHHp2bW6LiojFMVz6UaRkSpSfQeQItTSzn2M0VHiiLH-gaZZnJkik4_6ZR1TMQqF8M8gztDytFSC8s4 Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: d7994e24004a42ac88491cf70b3d1086 Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-DeleteServersTestJSON-633058460 Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 12:50:54.911460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 12:50:54.912802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7994e24004a42ac88491cf70b3d1086"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7994e24004a42ac88491cf70b3d1086"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7994e24004a42ac88491cf70b3d1086"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7994e24004a42ac88491cf70b3d1086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:50:54.912802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-DeleteServersTestJSON-633058460 Oct 03 12:50:54.912802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: d7994e24004a42ac88491cf70b3d1086 Oct 03 12:50:54.912802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-DeleteServersTestJSON-633058460 Oct 03 12:50:54.912802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-DeleteServersTestJSON-633058460-project Oct 03 12:50:54.912802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 12:50:54.912802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 12:50:54.912802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: f938505064304ae19cd0a6df370b7721 Oct 03 12:50:54.912802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-DeleteServersTestJSON-633058460-project Oct 03 12:50:54.912802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 12:50:54.912802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:54.912802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': 'ea0723fe-401f-47ef-8b51-22dd148860e9'} Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:50:54.913595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. Oct 03 12:50:54.914833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:50:54.916768 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d1e7831c-f0df-4173-8f3a-ef7e4657a902 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] Returning 404 to user: Instance ea0723fe-401f-47ef-8b51-22dd148860e9 could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:50:54.916768 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d1e7831c-f0df-4173-8f3a-ef7e4657a902 tempest-DeleteServersTestJSON-633058460 tempest-DeleteServersTestJSON-633058460-project] 10.222.0.33 "GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9" status: 404 len: 111 microversion: 2.1 time: 0.033313 Oct 03 12:50:54.916768 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 92/185] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:54 2022] GET /compute/v2.1/servers/ea0723fe-401f-47ef-8b51-22dd148860e9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:50:55.236145 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Flavor limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:50:55.237144 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Image limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:50:55.237696 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Flavor pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:50:55.239130 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Image pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:50:55.240124 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:50:55.251481 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:55.257198 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:55.258108 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:55.259597 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:55.263198 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:55.263198 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:55.283116 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Getting quotas for project eb983cfa7dfe47b19a0a2d5ba652dabb. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:50:55.288411 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Getting quotas for user 78b322344df24e8ca513c19361b79257 and project eb983cfa7dfe47b19a0a2d5ba652dabb. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:50:55.308306 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Going to run 1 instances... {{(pid=127542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:50:55.310904 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d585789-e496-433d-b311-70ec7ceffd99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:50:55.393951 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-5ebcd795-1511-49c2-bcfc-07a8c5494a6f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:55.394800 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-5ebcd795-1511-49c2-bcfc-07a8c5494a6f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:55.400898 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5ebcd795-1511-49c2-bcfc-07a8c5494a6f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:55.401364 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5ebcd795-1511-49c2-bcfc-07a8c5494a6f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:55.403113 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5ebcd795-1511-49c2-bcfc-07a8c5494a6f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:55.403113 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5ebcd795-1511-49c2-bcfc-07a8c5494a6f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:55.403113 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5ebcd795-1511-49c2-bcfc-07a8c5494a6f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:55.403450 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5ebcd795-1511-49c2-bcfc-07a8c5494a6f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:55.456293 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-0562bf3e-506e-4af3-93ec-32fd54f75d72 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737820 Oct 03 12:50:55.457830 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 94/186] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:50:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 12:50:55.472566 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3b7d041c-0020-4762-a2f3-c3b510a73d56 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:55.473484 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3b7d041c-0020-4762-a2f3-c3b510a73d56 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:55.667144 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3b7d041c-0020-4762-a2f3-c3b510a73d56 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:55.676233 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3b7d041c-0020-4762-a2f3-c3b510a73d56 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1213 microversion: 2.1 time: 0.208049 Oct 03 12:50:55.688882 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 95/187] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:55 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1213 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:55.720615 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5ebcd795-1511-49c2-bcfc-07a8c5494a6f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:55.732198 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-5ebcd795-1511-49c2-bcfc-07a8c5494a6f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.341840 Oct 03 12:50:55.733121 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 93/188] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:55 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:56.704347 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-6355ac4a-d0e8-4b66-a5b7-00e7acb346ff tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:56.705501 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-6355ac4a-d0e8-4b66-a5b7-00e7acb346ff tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:56.712580 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6355ac4a-d0e8-4b66-a5b7-00e7acb346ff tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:56.712998 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6355ac4a-d0e8-4b66-a5b7-00e7acb346ff tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:56.713596 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6355ac4a-d0e8-4b66-a5b7-00e7acb346ff tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:56.714897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6355ac4a-d0e8-4b66-a5b7-00e7acb346ff tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:56.715628 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6355ac4a-d0e8-4b66-a5b7-00e7acb346ff tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:56.716232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6355ac4a-d0e8-4b66-a5b7-00e7acb346ff tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:56.756412 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2dce7084-8202-4ce5-a312-42b105a0c117 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:56.758520 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2dce7084-8202-4ce5-a312-42b105a0c117 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:56.765558 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2dce7084-8202-4ce5-a312-42b105a0c117 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:56.766234 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2dce7084-8202-4ce5-a312-42b105a0c117 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:56.766858 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2dce7084-8202-4ce5-a312-42b105a0c117 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:56.767942 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2dce7084-8202-4ce5-a312-42b105a0c117 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:56.768611 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2dce7084-8202-4ce5-a312-42b105a0c117 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:56.769292 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2dce7084-8202-4ce5-a312-42b105a0c117 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:56.842494 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6355ac4a-d0e8-4b66-a5b7-00e7acb346ff tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:56.852620 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-6355ac4a-d0e8-4b66-a5b7-00e7acb346ff tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1217 microversion: 2.1 time: 0.151927 Oct 03 12:50:56.853875 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 96/189] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:56 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:56.967676 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2dce7084-8202-4ce5-a312-42b105a0c117 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:56.981888 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-2dce7084-8202-4ce5-a312-42b105a0c117 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.230145 Oct 03 12:50:56.982481 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 94/190] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:56 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:50:57.878192 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-cbe3aa19-f268-49e8-9907-6a70a935ff2b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:57.884317 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-cbe3aa19-f268-49e8-9907-6a70a935ff2b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:57.888501 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cbe3aa19-f268-49e8-9907-6a70a935ff2b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:57.893638 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cbe3aa19-f268-49e8-9907-6a70a935ff2b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:57.894932 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cbe3aa19-f268-49e8-9907-6a70a935ff2b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:57.895883 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cbe3aa19-f268-49e8-9907-6a70a935ff2b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:57.896525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cbe3aa19-f268-49e8-9907-6a70a935ff2b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:57.897166 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cbe3aa19-f268-49e8-9907-6a70a935ff2b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:57.967105 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-cbe3aa19-f268-49e8-9907-6a70a935ff2b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:57.975478 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-cbe3aa19-f268-49e8-9907-6a70a935ff2b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1265 microversion: 2.1 time: 0.101002 Oct 03 12:50:57.975976 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 97/191] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:57 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:58.006165 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-1e052f46-b8f2-46b0-8a15-41b83ff5d2d8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:58.007490 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-1e052f46-b8f2-46b0-8a15-41b83ff5d2d8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:58.013573 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1e052f46-b8f2-46b0-8a15-41b83ff5d2d8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:58.014133 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1e052f46-b8f2-46b0-8a15-41b83ff5d2d8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:58.014635 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1e052f46-b8f2-46b0-8a15-41b83ff5d2d8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:58.015427 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1e052f46-b8f2-46b0-8a15-41b83ff5d2d8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:58.016057 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1e052f46-b8f2-46b0-8a15-41b83ff5d2d8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:58.016586 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1e052f46-b8f2-46b0-8a15-41b83ff5d2d8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:58.323601 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-1e052f46-b8f2-46b0-8a15-41b83ff5d2d8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:58.339609 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-1e052f46-b8f2-46b0-8a15-41b83ff5d2d8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.330964 Oct 03 12:50:58.340294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 95/192] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:58 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:59.011023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-60d2fbb5-7683-4583-8fc7-373991b2e21e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:59.011685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-60d2fbb5-7683-4583-8fc7-373991b2e21e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:59.023451 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-60d2fbb5-7683-4583-8fc7-373991b2e21e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:59.023985 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-60d2fbb5-7683-4583-8fc7-373991b2e21e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:59.024427 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-60d2fbb5-7683-4583-8fc7-373991b2e21e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:59.043344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-60d2fbb5-7683-4583-8fc7-373991b2e21e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:59.043344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-60d2fbb5-7683-4583-8fc7-373991b2e21e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:59.043344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-60d2fbb5-7683-4583-8fc7-373991b2e21e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:59.163795 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-60d2fbb5-7683-4583-8fc7-373991b2e21e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:59.173794 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-60d2fbb5-7683-4583-8fc7-373991b2e21e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1271 microversion: 2.1 time: 0.167995 Oct 03 12:50:59.176206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 98/193] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:59 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:50:59.373205 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3db78b97-aea2-490f-8227-ce056cf92c48 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:50:59.374245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-3db78b97-aea2-490f-8227-ce056cf92c48 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:50:59.391779 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3db78b97-aea2-490f-8227-ce056cf92c48 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:59.395484 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3db78b97-aea2-490f-8227-ce056cf92c48 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:59.395974 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3db78b97-aea2-490f-8227-ce056cf92c48 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:59.397132 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3db78b97-aea2-490f-8227-ce056cf92c48 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:50:59.397646 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3db78b97-aea2-490f-8227-ce056cf92c48 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:50:59.399479 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3db78b97-aea2-490f-8227-ce056cf92c48 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:50:59.613445 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3db78b97-aea2-490f-8227-ce056cf92c48 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:50:59.623015 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-3db78b97-aea2-490f-8227-ce056cf92c48 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.261979 Oct 03 12:50:59.624360 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 96/194] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:50:59 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:00.198070 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b6f55eb2-0aa2-4454-a0c4-38d48ba9f48e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:00.198690 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b6f55eb2-0aa2-4454-a0c4-38d48ba9f48e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:00.205039 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b6f55eb2-0aa2-4454-a0c4-38d48ba9f48e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:00.205524 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b6f55eb2-0aa2-4454-a0c4-38d48ba9f48e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:00.205963 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b6f55eb2-0aa2-4454-a0c4-38d48ba9f48e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:00.207339 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b6f55eb2-0aa2-4454-a0c4-38d48ba9f48e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:00.207950 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b6f55eb2-0aa2-4454-a0c4-38d48ba9f48e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:00.208382 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b6f55eb2-0aa2-4454-a0c4-38d48ba9f48e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:00.421360 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-b6f55eb2-0aa2-4454-a0c4-38d48ba9f48e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:00.426025 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-b6f55eb2-0aa2-4454-a0c4-38d48ba9f48e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1313 microversion: 2.1 time: 0.231391 Oct 03 12:51:00.427391 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 99/195] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:00 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:00.652472 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-87b458be-8708-49aa-b9f0-95ad411ae5e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:00.654004 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-87b458be-8708-49aa-b9f0-95ad411ae5e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:00.662132 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-87b458be-8708-49aa-b9f0-95ad411ae5e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:00.662699 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-87b458be-8708-49aa-b9f0-95ad411ae5e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:00.663485 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-87b458be-8708-49aa-b9f0-95ad411ae5e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:00.667963 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-87b458be-8708-49aa-b9f0-95ad411ae5e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:00.667963 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-87b458be-8708-49aa-b9f0-95ad411ae5e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:00.667963 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-87b458be-8708-49aa-b9f0-95ad411ae5e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:00.670455 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=100 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:00.866990 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-87b458be-8708-49aa-b9f0-95ad411ae5e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:00.874928 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-87b458be-8708-49aa-b9f0-95ad411ae5e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.230409 Oct 03 12:51:00.875543 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 97/196] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:00 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:01.068531 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-f20339c1-e3d7-4b2f-98a5-360d41400578 req-6f44e261-cdc0-45a0-987e-9fd528404111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b5ec8a-b6d4-433c-9ec0-960af447bbf4", "tag": "1e5248e5-6283-4e4b-a79a-b3e2568037a1"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:51:01.078134 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-f20339c1-e3d7-4b2f-98a5-360d41400578 req-6f44e261-cdc0-45a0-987e-9fd528404111 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:01.078816 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-f20339c1-e3d7-4b2f-98a5-360d41400578 req-6f44e261-cdc0-45a0-987e-9fd528404111 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:01.079249 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-f20339c1-e3d7-4b2f-98a5-360d41400578 req-6f44e261-cdc0-45a0-987e-9fd528404111 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:01.092875 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-f20339c1-e3d7-4b2f-98a5-360d41400578 req-6f44e261-cdc0-45a0-987e-9fd528404111 service nova] Creating event network-changed:1e5248e5-6283-4e4b-a79a-b3e2568037a1 for instance 91b5ec8a-b6d4-433c-9ec0-960af447bbf4 on hv-cinder-84456 Oct 03 12:51:01.098944 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-f20339c1-e3d7-4b2f-98a5-360d41400578 req-6f44e261-cdc0-45a0-987e-9fd528404111 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034744 Oct 03 12:51:01.100158 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 100/197] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:51:01.452454 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-92adba82-a752-4e57-a175-6fd487aa8481 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:01.453080 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-92adba82-a752-4e57-a175-6fd487aa8481 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:01.464474 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92adba82-a752-4e57-a175-6fd487aa8481 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:01.464986 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92adba82-a752-4e57-a175-6fd487aa8481 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:01.465434 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92adba82-a752-4e57-a175-6fd487aa8481 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:01.466154 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92adba82-a752-4e57-a175-6fd487aa8481 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:01.470820 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92adba82-a752-4e57-a175-6fd487aa8481 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:01.471278 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92adba82-a752-4e57-a175-6fd487aa8481 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:01.654051 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-92adba82-a752-4e57-a175-6fd487aa8481 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:01.663227 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-92adba82-a752-4e57-a175-6fd487aa8481 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1313 microversion: 2.1 time: 0.214832 Oct 03 12:51:01.664730 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 98/198] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:01 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:01.903360 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d762d3d9-2b64-4e0b-ac4b-71c51e9808c7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:01.904070 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d762d3d9-2b64-4e0b-ac4b-71c51e9808c7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:01.914204 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d762d3d9-2b64-4e0b-ac4b-71c51e9808c7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:01.914893 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d762d3d9-2b64-4e0b-ac4b-71c51e9808c7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:01.916877 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d762d3d9-2b64-4e0b-ac4b-71c51e9808c7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:01.917801 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d762d3d9-2b64-4e0b-ac4b-71c51e9808c7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:01.918275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d762d3d9-2b64-4e0b-ac4b-71c51e9808c7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:01.918707 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d762d3d9-2b64-4e0b-ac4b-71c51e9808c7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:02.156538 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d762d3d9-2b64-4e0b-ac4b-71c51e9808c7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:02.164632 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d762d3d9-2b64-4e0b-ac4b-71c51e9808c7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.266226 Oct 03 12:51:02.183345 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 101/199] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:01 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:02.687236 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-907ddc06-66a5-4024-a01f-2597e7bce423 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:02.688087 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-907ddc06-66a5-4024-a01f-2597e7bce423 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:02.694970 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-907ddc06-66a5-4024-a01f-2597e7bce423 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:02.695523 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-907ddc06-66a5-4024-a01f-2597e7bce423 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:02.695992 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-907ddc06-66a5-4024-a01f-2597e7bce423 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:02.696685 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-907ddc06-66a5-4024-a01f-2597e7bce423 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:02.697140 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-907ddc06-66a5-4024-a01f-2597e7bce423 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:02.697568 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-907ddc06-66a5-4024-a01f-2597e7bce423 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:02.831588 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-907ddc06-66a5-4024-a01f-2597e7bce423 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:02.839102 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-907ddc06-66a5-4024-a01f-2597e7bce423 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1313 microversion: 2.1 time: 0.155669 Oct 03 12:51:02.839692 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 99/200] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:02 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:03.194085 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7dec71e7-0518-4ece-9cb3-67aae2a3e272 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:03.194708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-7dec71e7-0518-4ece-9cb3-67aae2a3e272 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:03.201371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7dec71e7-0518-4ece-9cb3-67aae2a3e272 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:03.202073 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7dec71e7-0518-4ece-9cb3-67aae2a3e272 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:03.202677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7dec71e7-0518-4ece-9cb3-67aae2a3e272 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:03.203620 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7dec71e7-0518-4ece-9cb3-67aae2a3e272 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:03.204159 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7dec71e7-0518-4ece-9cb3-67aae2a3e272 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:03.204789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7dec71e7-0518-4ece-9cb3-67aae2a3e272 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:03.362574 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-7dec71e7-0518-4ece-9cb3-67aae2a3e272 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:03.371470 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-7dec71e7-0518-4ece-9cb3-67aae2a3e272 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.182032 Oct 03 12:51:03.372095 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 102/201] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:03 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:03.862290 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a6b37ad7-556f-436a-8852-9c6680b6d916 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:03.863676 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a6b37ad7-556f-436a-8852-9c6680b6d916 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:03.870252 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6b37ad7-556f-436a-8852-9c6680b6d916 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:03.870726 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6b37ad7-556f-436a-8852-9c6680b6d916 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:03.871159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6b37ad7-556f-436a-8852-9c6680b6d916 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:03.871880 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6b37ad7-556f-436a-8852-9c6680b6d916 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:03.872331 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6b37ad7-556f-436a-8852-9c6680b6d916 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:03.872748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6b37ad7-556f-436a-8852-9c6680b6d916 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:04.010011 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-a6b37ad7-556f-436a-8852-9c6680b6d916 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:04.017962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a6b37ad7-556f-436a-8852-9c6680b6d916 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1313 microversion: 2.1 time: 0.159537 Oct 03 12:51:04.018649 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 100/202] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:03 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:04.396419 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-99eca4d2-8556-4fd2-8bf7-3ccd4c310775 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:04.397090 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-99eca4d2-8556-4fd2-8bf7-3ccd4c310775 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:04.403627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99eca4d2-8556-4fd2-8bf7-3ccd4c310775 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:04.404114 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99eca4d2-8556-4fd2-8bf7-3ccd4c310775 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:04.404546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99eca4d2-8556-4fd2-8bf7-3ccd4c310775 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:04.405231 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99eca4d2-8556-4fd2-8bf7-3ccd4c310775 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:04.405686 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99eca4d2-8556-4fd2-8bf7-3ccd4c310775 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:04.406107 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99eca4d2-8556-4fd2-8bf7-3ccd4c310775 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:04.532027 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-99eca4d2-8556-4fd2-8bf7-3ccd4c310775 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:04.539940 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-99eca4d2-8556-4fd2-8bf7-3ccd4c310775 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.148320 Oct 03 12:51:04.540510 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 103/203] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:04 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:05.041432 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a06d9509-23fd-440b-98f6-9b240605d292 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:05.042102 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a06d9509-23fd-440b-98f6-9b240605d292 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:05.047978 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a06d9509-23fd-440b-98f6-9b240605d292 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:05.048471 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a06d9509-23fd-440b-98f6-9b240605d292 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:05.048912 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a06d9509-23fd-440b-98f6-9b240605d292 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:05.049603 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a06d9509-23fd-440b-98f6-9b240605d292 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:05.050064 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a06d9509-23fd-440b-98f6-9b240605d292 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:05.051269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a06d9509-23fd-440b-98f6-9b240605d292 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:05.183707 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-a06d9509-23fd-440b-98f6-9b240605d292 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:05.192508 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a06d9509-23fd-440b-98f6-9b240605d292 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1313 microversion: 2.1 time: 0.154827 Oct 03 12:51:05.193081 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 101/204] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:05 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:05.564161 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-5a89a09f-8343-43c3-b11c-c9462386e35c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:05.564952 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-5a89a09f-8343-43c3-b11c-c9462386e35c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:05.567840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:05.573192 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5a89a09f-8343-43c3-b11c-c9462386e35c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:05.573766 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5a89a09f-8343-43c3-b11c-c9462386e35c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:05.574278 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5a89a09f-8343-43c3-b11c-c9462386e35c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:05.575048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5a89a09f-8343-43c3-b11c-c9462386e35c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:05.575604 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5a89a09f-8343-43c3-b11c-c9462386e35c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:05.576104 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5a89a09f-8343-43c3-b11c-c9462386e35c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:05.674879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=8 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:05.710602 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-5a89a09f-8343-43c3-b11c-c9462386e35c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:05.718562 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-5a89a09f-8343-43c3-b11c-c9462386e35c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.158650 Oct 03 12:51:05.719123 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 104/205] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:05 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:06.221623 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d4825a51-7a00-4e58-b501-ac9314677ad9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:06.223808 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d4825a51-7a00-4e58-b501-ac9314677ad9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:06.238067 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d4825a51-7a00-4e58-b501-ac9314677ad9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:06.238067 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d4825a51-7a00-4e58-b501-ac9314677ad9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:06.238067 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d4825a51-7a00-4e58-b501-ac9314677ad9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:06.238067 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d4825a51-7a00-4e58-b501-ac9314677ad9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:06.241455 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d4825a51-7a00-4e58-b501-ac9314677ad9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:06.249945 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d4825a51-7a00-4e58-b501-ac9314677ad9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:06.427931 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d4825a51-7a00-4e58-b501-ac9314677ad9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:06.437045 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d4825a51-7a00-4e58-b501-ac9314677ad9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1313 microversion: 2.1 time: 0.220247 Oct 03 12:51:06.437603 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 102/206] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:06 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:06.743210 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-27d18f2e-7430-4620-9f65-7683923c3aa5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:06.743864 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-27d18f2e-7430-4620-9f65-7683923c3aa5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:06.751872 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-27d18f2e-7430-4620-9f65-7683923c3aa5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:06.752353 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-27d18f2e-7430-4620-9f65-7683923c3aa5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:06.752786 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-27d18f2e-7430-4620-9f65-7683923c3aa5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:06.753509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-27d18f2e-7430-4620-9f65-7683923c3aa5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:06.753960 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-27d18f2e-7430-4620-9f65-7683923c3aa5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:06.754392 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-27d18f2e-7430-4620-9f65-7683923c3aa5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:06.884949 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-27d18f2e-7430-4620-9f65-7683923c3aa5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:06.892862 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-27d18f2e-7430-4620-9f65-7683923c3aa5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.154785 Oct 03 12:51:06.893425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 105/207] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:06 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:07.461625 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2d78dcc7-97c1-4155-b709-1972dd7d66bf tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:07.462266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2d78dcc7-97c1-4155-b709-1972dd7d66bf tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:07.468380 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2d78dcc7-97c1-4155-b709-1972dd7d66bf tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:07.468866 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2d78dcc7-97c1-4155-b709-1972dd7d66bf tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:07.469302 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2d78dcc7-97c1-4155-b709-1972dd7d66bf tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:07.470022 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2d78dcc7-97c1-4155-b709-1972dd7d66bf tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:07.470474 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2d78dcc7-97c1-4155-b709-1972dd7d66bf tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:07.470900 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2d78dcc7-97c1-4155-b709-1972dd7d66bf tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:07.639683 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2d78dcc7-97c1-4155-b709-1972dd7d66bf tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:07.648246 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-2d78dcc7-97c1-4155-b709-1972dd7d66bf tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1313 microversion: 2.1 time: 0.191175 Oct 03 12:51:07.648823 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 103/208] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:07 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:07.815704 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-18aff484-e14a-44bc-b303-acdfae7feb34 req-86cf8276-7ca7-4569-b36e-41c76ee006be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b5ec8a-b6d4-433c-9ec0-960af447bbf4", "name": "network-vif-plugged", "status": "completed", "tag": "1e5248e5-6283-4e4b-a79a-b3e2568037a1"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:51:07.828902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-18aff484-e14a-44bc-b303-acdfae7feb34 req-86cf8276-7ca7-4569-b36e-41c76ee006be service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:07.828902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-18aff484-e14a-44bc-b303-acdfae7feb34 req-86cf8276-7ca7-4569-b36e-41c76ee006be service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:07.829195 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-18aff484-e14a-44bc-b303-acdfae7feb34 req-86cf8276-7ca7-4569-b36e-41c76ee006be service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:07.841263 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-18aff484-e14a-44bc-b303-acdfae7feb34 req-86cf8276-7ca7-4569-b36e-41c76ee006be service nova] Creating event network-vif-plugged:1e5248e5-6283-4e4b-a79a-b3e2568037a1 for instance 91b5ec8a-b6d4-433c-9ec0-960af447bbf4 on hv-cinder-84456 Oct 03 12:51:07.846398 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-18aff484-e14a-44bc-b303-acdfae7feb34 req-86cf8276-7ca7-4569-b36e-41c76ee006be service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034904 Oct 03 12:51:07.847000 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 106/209] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:51:07.918317 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-efc18953-d981-494c-9605-710597410c72 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:07.919194 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-efc18953-d981-494c-9605-710597410c72 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:07.925880 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-efc18953-d981-494c-9605-710597410c72 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:07.926606 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-efc18953-d981-494c-9605-710597410c72 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:07.927203 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-efc18953-d981-494c-9605-710597410c72 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:07.928808 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-efc18953-d981-494c-9605-710597410c72 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:07.929416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-efc18953-d981-494c-9605-710597410c72 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:07.929991 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-efc18953-d981-494c-9605-710597410c72 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:08.099662 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-efc18953-d981-494c-9605-710597410c72 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:08.107772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-efc18953-d981-494c-9605-710597410c72 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1521 microversion: 2.1 time: 0.194887 Oct 03 12:51:08.115721 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 104/210] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:07 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:08.671732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e557dbdb-08f5-4a53-86fb-ad88932e42b9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:08.672584 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e557dbdb-08f5-4a53-86fb-ad88932e42b9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:08.679443 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e557dbdb-08f5-4a53-86fb-ad88932e42b9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:08.680053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e557dbdb-08f5-4a53-86fb-ad88932e42b9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:08.680671 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e557dbdb-08f5-4a53-86fb-ad88932e42b9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:08.681376 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e557dbdb-08f5-4a53-86fb-ad88932e42b9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:08.681974 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e557dbdb-08f5-4a53-86fb-ad88932e42b9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:08.682548 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e557dbdb-08f5-4a53-86fb-ad88932e42b9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:08.866228 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e557dbdb-08f5-4a53-86fb-ad88932e42b9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:08.874922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e557dbdb-08f5-4a53-86fb-ad88932e42b9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1313 microversion: 2.1 time: 0.207316 Oct 03 12:51:08.879698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 107/211] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:08 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:09.133588 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-85244483-9aad-4cc4-8d55-1ff1f01a4053 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:09.137998 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-85244483-9aad-4cc4-8d55-1ff1f01a4053 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:09.140131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=54 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:09.146028 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-85244483-9aad-4cc4-8d55-1ff1f01a4053 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:09.146511 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-85244483-9aad-4cc4-8d55-1ff1f01a4053 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:09.147126 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-85244483-9aad-4cc4-8d55-1ff1f01a4053 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:09.158260 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-85244483-9aad-4cc4-8d55-1ff1f01a4053 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:09.158928 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-85244483-9aad-4cc4-8d55-1ff1f01a4053 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:09.159545 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-85244483-9aad-4cc4-8d55-1ff1f01a4053 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:09.304380 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-85244483-9aad-4cc4-8d55-1ff1f01a4053 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:09.312804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-85244483-9aad-4cc4-8d55-1ff1f01a4053 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1501 microversion: 2.1 time: 0.184719 Oct 03 12:51:09.313679 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 105/212] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:09 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1501 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:09.336319 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3c0e0e67-2c32-43f0-84eb-f190866fde67 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:09.336943 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3c0e0e67-2c32-43f0-84eb-f190866fde67 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:09.343278 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c0e0e67-2c32-43f0-84eb-f190866fde67 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:09.343436 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c0e0e67-2c32-43f0-84eb-f190866fde67 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:09.343781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c0e0e67-2c32-43f0-84eb-f190866fde67 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:09.344466 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c0e0e67-2c32-43f0-84eb-f190866fde67 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:09.344920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c0e0e67-2c32-43f0-84eb-f190866fde67 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:09.345340 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c0e0e67-2c32-43f0-84eb-f190866fde67 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:09.484571 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3c0e0e67-2c32-43f0-84eb-f190866fde67 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:09.493392 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3c0e0e67-2c32-43f0-84eb-f190866fde67 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1516 microversion: 2.1 time: 0.161135 Oct 03 12:51:09.493959 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 108/213] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:09 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:09.899550 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-7b16a472-1737-4d87-aa31-031d37844525 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:09.900162 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-7b16a472-1737-4d87-aa31-031d37844525 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:09.906214 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7b16a472-1737-4d87-aa31-031d37844525 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:09.906701 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7b16a472-1737-4d87-aa31-031d37844525 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:09.907130 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7b16a472-1737-4d87-aa31-031d37844525 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:09.908283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7b16a472-1737-4d87-aa31-031d37844525 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:09.908740 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7b16a472-1737-4d87-aa31-031d37844525 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:09.909165 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7b16a472-1737-4d87-aa31-031d37844525 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:10.108124 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7b16a472-1737-4d87-aa31-031d37844525 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:10.108124 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-7b16a472-1737-4d87-aa31-031d37844525 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1313 microversion: 2.1 time: 0.181829 Oct 03 12:51:10.108124 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 106/214] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:09 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:11.118672 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f7030b68-8d8e-4a28-bae1-66a0608c40d9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:11.119936 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f7030b68-8d8e-4a28-bae1-66a0608c40d9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:11.122962 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:11.129335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f7030b68-8d8e-4a28-bae1-66a0608c40d9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:11.129825 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f7030b68-8d8e-4a28-bae1-66a0608c40d9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:11.130259 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f7030b68-8d8e-4a28-bae1-66a0608c40d9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:11.130960 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f7030b68-8d8e-4a28-bae1-66a0608c40d9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:11.131429 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f7030b68-8d8e-4a28-bae1-66a0608c40d9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:11.132028 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f7030b68-8d8e-4a28-bae1-66a0608c40d9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:11.280950 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-f7030b68-8d8e-4a28-bae1-66a0608c40d9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:11.300931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f7030b68-8d8e-4a28-bae1-66a0608c40d9 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1498 microversion: 2.1 time: 0.185777 Oct 03 12:51:11.303544 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 109/215] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:11 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1498 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:11.449800 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-fba64711-9b62-4baf-9ae8-274b96d92765 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:51:11.452029 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-fba64711-9b62-4baf-9ae8-274b96d92765 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:11.458258 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fba64711-9b62-4baf-9ae8-274b96d92765 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:11.458977 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fba64711-9b62-4baf-9ae8-274b96d92765 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:11.459439 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fba64711-9b62-4baf-9ae8-274b96d92765 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:11.460137 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fba64711-9b62-4baf-9ae8-274b96d92765 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:11.460588 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fba64711-9b62-4baf-9ae8-274b96d92765 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:11.461065 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fba64711-9b62-4baf-9ae8-274b96d92765 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:11.484652 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-fba64711-9b62-4baf-9ae8-274b96d92765 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lazy-loading 'flavor' on Instance uuid f9909a9d-feb5-4513-9e14-6aadc4e17c59 {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:51:11.881933 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-fba64711-9b62-4baf-9ae8-274b96d92765 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "POST /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59/action" status: 200 len: 32 microversion: 2.1 time: 0.436145 Oct 03 12:51:11.884809 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 107/216] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 12:51:11 2022] POST /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59/action => generated 32 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 12:51:11.897164 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-5ab94401-1de0-479a-a452-57b5ebeef614 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:11.902450 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-5ab94401-1de0-479a-a452-57b5ebeef614 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:11.908777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5ab94401-1de0-479a-a452-57b5ebeef614 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:11.909498 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5ab94401-1de0-479a-a452-57b5ebeef614 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:11.910156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5ab94401-1de0-479a-a452-57b5ebeef614 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:11.910974 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5ab94401-1de0-479a-a452-57b5ebeef614 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:11.911396 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5ab94401-1de0-479a-a452-57b5ebeef614 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:11.911900 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5ab94401-1de0-479a-a452-57b5ebeef614 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:12.083051 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-5ab94401-1de0-479a-a452-57b5ebeef614 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:12.090856 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-5ab94401-1de0-479a-a452-57b5ebeef614 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.201756 Oct 03 12:51:12.091436 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 110/217] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:11 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:12.534282 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2fb215f3-c503-499d-8f21-ec50fd96f385 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:12.535624 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2fb215f3-c503-499d-8f21-ec50fd96f385 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:12.542574 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2fb215f3-c503-499d-8f21-ec50fd96f385 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:12.543211 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2fb215f3-c503-499d-8f21-ec50fd96f385 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:12.543818 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2fb215f3-c503-499d-8f21-ec50fd96f385 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:12.544570 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2fb215f3-c503-499d-8f21-ec50fd96f385 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:12.545028 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2fb215f3-c503-499d-8f21-ec50fd96f385 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:12.545451 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2fb215f3-c503-499d-8f21-ec50fd96f385 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:12.578838 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2fb215f3-c503-499d-8f21-ec50fd96f385 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Going to try to terminate instance {{(pid=127544) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:51:12.964638 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-2fb215f3-c503-499d-8f21-ec50fd96f385 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "DELETE /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 204 len: 0 microversion: 2.1 time: 0.431599 Oct 03 12:51:12.965962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 108/218] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:51:12 2022] DELETE /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:51:12.976936 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-5987a68f-7613-46b8-961f-00963139961e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:12.977628 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-5987a68f-7613-46b8-961f-00963139961e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:12.989045 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5987a68f-7613-46b8-961f-00963139961e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:12.990158 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5987a68f-7613-46b8-961f-00963139961e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:12.990668 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5987a68f-7613-46b8-961f-00963139961e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:12.991570 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5987a68f-7613-46b8-961f-00963139961e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:12.992080 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5987a68f-7613-46b8-961f-00963139961e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:12.992580 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5987a68f-7613-46b8-961f-00963139961e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:13.117622 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c1200081-c131-49c2-aa60-d54363f37792 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:13.118556 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-c1200081-c131-49c2-aa60-d54363f37792 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:13.125628 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-5987a68f-7613-46b8-961f-00963139961e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:13.126037 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c1200081-c131-49c2-aa60-d54363f37792 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:13.126755 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c1200081-c131-49c2-aa60-d54363f37792 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:13.127240 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c1200081-c131-49c2-aa60-d54363f37792 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:13.128129 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c1200081-c131-49c2-aa60-d54363f37792 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:13.129392 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c1200081-c131-49c2-aa60-d54363f37792 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:13.129817 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c1200081-c131-49c2-aa60-d54363f37792 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:13.137704 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-5987a68f-7613-46b8-961f-00963139961e tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1504 microversion: 2.1 time: 0.165311 Oct 03 12:51:13.152279 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 111/219] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:12 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:13.272452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c1200081-c131-49c2-aa60-d54363f37792 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:13.280379 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c1200081-c131-49c2-aa60-d54363f37792 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.168808 Oct 03 12:51:13.280933 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 109/220] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:13 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:51:14.166328 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-793ad14e-be7f-424b-8978-a89bca87dd27 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:14.166983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-793ad14e-be7f-424b-8978-a89bca87dd27 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:14.173904 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-793ad14e-be7f-424b-8978-a89bca87dd27 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:14.174406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-793ad14e-be7f-424b-8978-a89bca87dd27 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:14.174836 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-793ad14e-be7f-424b-8978-a89bca87dd27 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:14.175703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-793ad14e-be7f-424b-8978-a89bca87dd27 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:14.176160 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-793ad14e-be7f-424b-8978-a89bca87dd27 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:14.176584 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-793ad14e-be7f-424b-8978-a89bca87dd27 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:14.305850 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3f3fc06d-8d54-44ba-86eb-18320b7f50e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:14.306550 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-3f3fc06d-8d54-44ba-86eb-18320b7f50e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:14.309321 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-793ad14e-be7f-424b-8978-a89bca87dd27 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:14.320907 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f3fc06d-8d54-44ba-86eb-18320b7f50e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:14.321408 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f3fc06d-8d54-44ba-86eb-18320b7f50e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:14.321851 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f3fc06d-8d54-44ba-86eb-18320b7f50e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:14.322554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f3fc06d-8d54-44ba-86eb-18320b7f50e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:14.322758 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-793ad14e-be7f-424b-8978-a89bca87dd27 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1504 microversion: 2.1 time: 0.160094 Oct 03 12:51:14.323007 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f3fc06d-8d54-44ba-86eb-18320b7f50e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:14.323464 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f3fc06d-8d54-44ba-86eb-18320b7f50e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:14.323601 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 112/221] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:14 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:51:14.331283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:14.463416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3f3fc06d-8d54-44ba-86eb-18320b7f50e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:14.471710 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-3f3fc06d-8d54-44ba-86eb-18320b7f50e3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.171757 Oct 03 12:51:14.472471 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 110/222] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:14 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:51:15.346515 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-dc19dae4-40db-44cf-a2da-ffc18f04dc85 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:15.347130 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-dc19dae4-40db-44cf-a2da-ffc18f04dc85 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:15.354708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dc19dae4-40db-44cf-a2da-ffc18f04dc85 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:15.355197 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dc19dae4-40db-44cf-a2da-ffc18f04dc85 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:15.355763 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dc19dae4-40db-44cf-a2da-ffc18f04dc85 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:15.356456 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dc19dae4-40db-44cf-a2da-ffc18f04dc85 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:15.356906 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dc19dae4-40db-44cf-a2da-ffc18f04dc85 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:15.357354 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dc19dae4-40db-44cf-a2da-ffc18f04dc85 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:15.375910 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=100 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:15.495250 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2083767a-55c5-41fc-be6f-b4a8b8016d1e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:15.495895 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2083767a-55c5-41fc-be6f-b4a8b8016d1e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:15.502641 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2083767a-55c5-41fc-be6f-b4a8b8016d1e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:15.503118 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2083767a-55c5-41fc-be6f-b4a8b8016d1e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:15.503856 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2083767a-55c5-41fc-be6f-b4a8b8016d1e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:15.504573 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2083767a-55c5-41fc-be6f-b4a8b8016d1e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:15.505001 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2083767a-55c5-41fc-be6f-b4a8b8016d1e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:15.505423 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2083767a-55c5-41fc-be6f-b4a8b8016d1e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:15.505531 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-dc19dae4-40db-44cf-a2da-ffc18f04dc85 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:15.513775 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-dc19dae4-40db-44cf-a2da-ffc18f04dc85 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1504 microversion: 2.1 time: 0.171044 Oct 03 12:51:15.514338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 113/223] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:15 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:51:15.666237 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2083767a-55c5-41fc-be6f-b4a8b8016d1e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:15.674005 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-2083767a-55c5-41fc-be6f-b4a8b8016d1e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.182604 Oct 03 12:51:15.674575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 111/224] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:15 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:51:16.537620 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-5dc2c38b-f6bc-47e2-a8a3-7f1263dd0cfc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:16.539003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-5dc2c38b-f6bc-47e2-a8a3-7f1263dd0cfc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:16.546224 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5dc2c38b-f6bc-47e2-a8a3-7f1263dd0cfc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:16.546720 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5dc2c38b-f6bc-47e2-a8a3-7f1263dd0cfc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:16.547163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5dc2c38b-f6bc-47e2-a8a3-7f1263dd0cfc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:16.547917 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5dc2c38b-f6bc-47e2-a8a3-7f1263dd0cfc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:16.548376 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5dc2c38b-f6bc-47e2-a8a3-7f1263dd0cfc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:16.548869 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5dc2c38b-f6bc-47e2-a8a3-7f1263dd0cfc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:16.688130 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-5dc2c38b-f6bc-47e2-a8a3-7f1263dd0cfc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:16.696577 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-5dc2c38b-f6bc-47e2-a8a3-7f1263dd0cfc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1504 microversion: 2.1 time: 0.163282 Oct 03 12:51:16.697149 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 114/225] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:16 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:16.699233 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-46a61daa-1419-4bdb-8ffd-25bc98354c09 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:16.699964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-46a61daa-1419-4bdb-8ffd-25bc98354c09 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:16.707126 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-46a61daa-1419-4bdb-8ffd-25bc98354c09 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:16.707758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-46a61daa-1419-4bdb-8ffd-25bc98354c09 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:16.708374 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-46a61daa-1419-4bdb-8ffd-25bc98354c09 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:16.709064 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-46a61daa-1419-4bdb-8ffd-25bc98354c09 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:16.709512 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-46a61daa-1419-4bdb-8ffd-25bc98354c09 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:16.710129 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-46a61daa-1419-4bdb-8ffd-25bc98354c09 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:16.841438 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-46a61daa-1419-4bdb-8ffd-25bc98354c09 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:16.849649 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-46a61daa-1419-4bdb-8ffd-25bc98354c09 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.154279 Oct 03 12:51:16.850207 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 112/226] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:16 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:17.721809 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b90b70a1-d980-4beb-bd00-1a225df10de7 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:17.723581 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b90b70a1-d980-4beb-bd00-1a225df10de7 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:17.731661 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b90b70a1-d980-4beb-bd00-1a225df10de7 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:17.743338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b90b70a1-d980-4beb-bd00-1a225df10de7 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:17.743338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b90b70a1-d980-4beb-bd00-1a225df10de7 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:17.743338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b90b70a1-d980-4beb-bd00-1a225df10de7 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:17.743338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b90b70a1-d980-4beb-bd00-1a225df10de7 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:17.743799 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b90b70a1-d980-4beb-bd00-1a225df10de7 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:17.869014 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-b90b70a1-d980-4beb-bd00-1a225df10de7 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:17.872765 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e861851c-c6c2-46e3-bdff-0224d7df549a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:17.873962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-e861851c-c6c2-46e3-bdff-0224d7df549a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:17.877387 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-b90b70a1-d980-4beb-bd00-1a225df10de7 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1504 microversion: 2.1 time: 0.160452 Oct 03 12:51:17.878102 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 115/227] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:17 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:17.880459 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e861851c-c6c2-46e3-bdff-0224d7df549a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:17.881147 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e861851c-c6c2-46e3-bdff-0224d7df549a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:17.881585 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e861851c-c6c2-46e3-bdff-0224d7df549a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:17.882286 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e861851c-c6c2-46e3-bdff-0224d7df549a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:17.882738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e861851c-c6c2-46e3-bdff-0224d7df549a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:17.883161 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e861851c-c6c2-46e3-bdff-0224d7df549a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:18.013511 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e861851c-c6c2-46e3-bdff-0224d7df549a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:18.022024 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e861851c-c6c2-46e3-bdff-0224d7df549a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.153455 Oct 03 12:51:18.022595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 113/228] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:17 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:18.901502 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ad1dbb7c-a521-4577-a844-982890b2e6fd tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:18.902171 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-ad1dbb7c-a521-4577-a844-982890b2e6fd tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:18.909819 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ad1dbb7c-a521-4577-a844-982890b2e6fd tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:18.910599 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ad1dbb7c-a521-4577-a844-982890b2e6fd tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:18.911246 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ad1dbb7c-a521-4577-a844-982890b2e6fd tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:18.912022 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ad1dbb7c-a521-4577-a844-982890b2e6fd tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:18.912482 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ad1dbb7c-a521-4577-a844-982890b2e6fd tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:18.912958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ad1dbb7c-a521-4577-a844-982890b2e6fd tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:19.046237 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-fef5ddac-ef8b-49a9-9439-b7478940c6c8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:19.047367 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-fef5ddac-ef8b-49a9-9439-b7478940c6c8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:19.058586 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fef5ddac-ef8b-49a9-9439-b7478940c6c8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:19.059113 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-ad1dbb7c-a521-4577-a844-982890b2e6fd tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:19.062876 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fef5ddac-ef8b-49a9-9439-b7478940c6c8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:19.063477 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fef5ddac-ef8b-49a9-9439-b7478940c6c8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:19.064471 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fef5ddac-ef8b-49a9-9439-b7478940c6c8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:19.065195 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fef5ddac-ef8b-49a9-9439-b7478940c6c8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:19.065641 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fef5ddac-ef8b-49a9-9439-b7478940c6c8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:19.072834 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-ad1dbb7c-a521-4577-a844-982890b2e6fd tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1504 microversion: 2.1 time: 0.175130 Oct 03 12:51:19.076480 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 116/229] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:18 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:51:19.213836 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-fef5ddac-ef8b-49a9-9439-b7478940c6c8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:19.221588 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-fef5ddac-ef8b-49a9-9439-b7478940c6c8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.179930 Oct 03 12:51:19.223892 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 114/230] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:19 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:19.385091 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-0f2fa283-5921-4e37-8650-b3114d93a56e req-fd06d0fc-23fa-49b5-8e1f-ff0074207439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b5ec8a-b6d4-433c-9ec0-960af447bbf4", "name": "network-vif-deleted", "tag": "1e5248e5-6283-4e4b-a79a-b3e2568037a1"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:51:19.394612 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-0f2fa283-5921-4e37-8650-b3114d93a56e req-fd06d0fc-23fa-49b5-8e1f-ff0074207439 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:19.395100 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-0f2fa283-5921-4e37-8650-b3114d93a56e req-fd06d0fc-23fa-49b5-8e1f-ff0074207439 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:19.395701 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-0f2fa283-5921-4e37-8650-b3114d93a56e req-fd06d0fc-23fa-49b5-8e1f-ff0074207439 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:19.406309 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-0f2fa283-5921-4e37-8650-b3114d93a56e req-fd06d0fc-23fa-49b5-8e1f-ff0074207439 service nova] Creating event network-vif-deleted:1e5248e5-6283-4e4b-a79a-b3e2568037a1 for instance 91b5ec8a-b6d4-433c-9ec0-960af447bbf4 on hv-cinder-84456 Oct 03 12:51:19.412175 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-0f2fa283-5921-4e37-8650-b3114d93a56e req-fd06d0fc-23fa-49b5-8e1f-ff0074207439 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031115 Oct 03 12:51:19.412968 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 117/231] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:51:20.106063 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3aeede71-2e2b-407a-ae97-e6dc18cb8290 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:20.106063 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-3aeede71-2e2b-407a-ae97-e6dc18cb8290 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:20.114111 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3aeede71-2e2b-407a-ae97-e6dc18cb8290 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:20.114952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3aeede71-2e2b-407a-ae97-e6dc18cb8290 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:20.115649 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3aeede71-2e2b-407a-ae97-e6dc18cb8290 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:20.116539 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3aeede71-2e2b-407a-ae97-e6dc18cb8290 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:20.117236 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3aeede71-2e2b-407a-ae97-e6dc18cb8290 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:20.117879 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3aeede71-2e2b-407a-ae97-e6dc18cb8290 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:20.153623 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3aeede71-2e2b-407a-ae97-e6dc18cb8290 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:20.154141 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3aeede71-2e2b-407a-ae97-e6dc18cb8290 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:20.154624 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3aeede71-2e2b-407a-ae97-e6dc18cb8290 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:20.155064 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-3aeede71-2e2b-407a-ae97-e6dc18cb8290 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lazy-loading 'fault' on Instance uuid 91b5ec8a-b6d4-433c-9ec0-960af447bbf4 {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:51:20.202791 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3aeede71-2e2b-407a-ae97-e6dc18cb8290 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:20.212886 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-3aeede71-2e2b-407a-ae97-e6dc18cb8290 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1303 microversion: 2.1 time: 0.114401 Oct 03 12:51:20.213807 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 115/232] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:20 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:20.248254 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-53680b93-7a30-4db6-b1ef-e7b96770fda5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:20.255359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-53680b93-7a30-4db6-b1ef-e7b96770fda5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:20.257968 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53680b93-7a30-4db6-b1ef-e7b96770fda5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:20.258463 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53680b93-7a30-4db6-b1ef-e7b96770fda5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:20.258903 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53680b93-7a30-4db6-b1ef-e7b96770fda5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:20.259643 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53680b93-7a30-4db6-b1ef-e7b96770fda5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:20.260099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53680b93-7a30-4db6-b1ef-e7b96770fda5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:20.260548 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53680b93-7a30-4db6-b1ef-e7b96770fda5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:20.410914 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-53680b93-7a30-4db6-b1ef-e7b96770fda5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:20.418685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-53680b93-7a30-4db6-b1ef-e7b96770fda5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.176364 Oct 03 12:51:20.419477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 118/233] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:20 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:21.241549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-5d6bcfc2-33fc-44b7-bb44-db7327df5af5 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:21.242197 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-5d6bcfc2-33fc-44b7-bb44-db7327df5af5 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:21.248232 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5d6bcfc2-33fc-44b7-bb44-db7327df5af5 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:21.248715 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5d6bcfc2-33fc-44b7-bb44-db7327df5af5 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:21.249152 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5d6bcfc2-33fc-44b7-bb44-db7327df5af5 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:21.249845 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5d6bcfc2-33fc-44b7-bb44-db7327df5af5 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:21.250297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5d6bcfc2-33fc-44b7-bb44-db7327df5af5 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:21.250720 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5d6bcfc2-33fc-44b7-bb44-db7327df5af5 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:21.283137 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5d6bcfc2-33fc-44b7-bb44-db7327df5af5 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:21.283665 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5d6bcfc2-33fc-44b7-bb44-db7327df5af5 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:21.284103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5d6bcfc2-33fc-44b7-bb44-db7327df5af5 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:21.284553 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-5d6bcfc2-33fc-44b7-bb44-db7327df5af5 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lazy-loading 'fault' on Instance uuid 91b5ec8a-b6d4-433c-9ec0-960af447bbf4 {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:51:21.326925 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5d6bcfc2-33fc-44b7-bb44-db7327df5af5 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:21.335430 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-5d6bcfc2-33fc-44b7-bb44-db7327df5af5 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1303 microversion: 2.1 time: 0.098011 Oct 03 12:51:21.344845 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 116/234] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:21 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:51:21.442846 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a842a0b0-b344-464c-b805-0e3db7b6c675 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:21.443414 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a842a0b0-b344-464c-b805-0e3db7b6c675 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:21.449853 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a842a0b0-b344-464c-b805-0e3db7b6c675 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:21.450341 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a842a0b0-b344-464c-b805-0e3db7b6c675 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:21.450774 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a842a0b0-b344-464c-b805-0e3db7b6c675 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:21.451498 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a842a0b0-b344-464c-b805-0e3db7b6c675 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:21.451951 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a842a0b0-b344-464c-b805-0e3db7b6c675 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:21.452374 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a842a0b0-b344-464c-b805-0e3db7b6c675 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:21.582713 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a842a0b0-b344-464c-b805-0e3db7b6c675 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:21.590385 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a842a0b0-b344-464c-b805-0e3db7b6c675 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.151919 Oct 03 12:51:21.590947 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 119/235] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:21 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:22.357855 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-559710f9-c628-4e6d-978a-fecb26cd60b6 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:22.358500 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-559710f9-c628-4e6d-978a-fecb26cd60b6 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:22.365411 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-559710f9-c628-4e6d-978a-fecb26cd60b6 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:22.365888 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-559710f9-c628-4e6d-978a-fecb26cd60b6 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:22.366316 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-559710f9-c628-4e6d-978a-fecb26cd60b6 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:22.366994 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-559710f9-c628-4e6d-978a-fecb26cd60b6 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:22.367474 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-559710f9-c628-4e6d-978a-fecb26cd60b6 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:22.367894 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-559710f9-c628-4e6d-978a-fecb26cd60b6 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:22.400502 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-559710f9-c628-4e6d-978a-fecb26cd60b6 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:22.400989 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-559710f9-c628-4e6d-978a-fecb26cd60b6 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:22.401427 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-559710f9-c628-4e6d-978a-fecb26cd60b6 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:22.401870 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-559710f9-c628-4e6d-978a-fecb26cd60b6 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lazy-loading 'fault' on Instance uuid 91b5ec8a-b6d4-433c-9ec0-960af447bbf4 {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:51:22.445249 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-559710f9-c628-4e6d-978a-fecb26cd60b6 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:22.452908 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-559710f9-c628-4e6d-978a-fecb26cd60b6 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 200 len: 1303 microversion: 2.1 time: 0.098832 Oct 03 12:51:22.453460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 117/236] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:22 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:22.612914 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4805fb61-23c6-4e27-8f59-3977d80fdfb9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:22.613404 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-4805fb61-23c6-4e27-8f59-3977d80fdfb9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:22.620269 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4805fb61-23c6-4e27-8f59-3977d80fdfb9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:22.620755 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4805fb61-23c6-4e27-8f59-3977d80fdfb9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:22.621196 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4805fb61-23c6-4e27-8f59-3977d80fdfb9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:22.621886 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4805fb61-23c6-4e27-8f59-3977d80fdfb9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:22.622343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4805fb61-23c6-4e27-8f59-3977d80fdfb9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:22.622770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4805fb61-23c6-4e27-8f59-3977d80fdfb9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:22.748793 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4805fb61-23c6-4e27-8f59-3977d80fdfb9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:22.756388 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-4805fb61-23c6-4e27-8f59-3977d80fdfb9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.147493 Oct 03 12:51:22.756956 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 120/237] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:22 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:23.475852 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-fcb63f63-a032-4ee2-a0ca-6d6c92011055 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:23.481351 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-fcb63f63-a032-4ee2-a0ca-6d6c92011055 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: 91b5ec8a-b6d4-433c-9ec0-960af447bbf4] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:23.483142 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fcb63f63-a032-4ee2-a0ca-6d6c92011055 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:23.483672 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fcb63f63-a032-4ee2-a0ca-6d6c92011055 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:23.484109 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fcb63f63-a032-4ee2-a0ca-6d6c92011055 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:23.484812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fcb63f63-a032-4ee2-a0ca-6d6c92011055 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:23.485268 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fcb63f63-a032-4ee2-a0ca-6d6c92011055 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:23.485689 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fcb63f63-a032-4ee2-a0ca-6d6c92011055 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-fcb63f63-a032-4ee2-a0ca-6d6c92011055 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] HTTP exception thrown: Instance 91b5ec8a-b6d4-433c-9ec0-960af447bbf4 could not be found. Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-fcb63f63-a032-4ee2-a0ca-6d6c92011055 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Request method failure captured: Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 HTTP/1.1 Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtqsb2mPqKe69VW6LBgeyDPjBoYw2Xb3VX80UYu1RJEe72OlHsIGzJINu3VcZAOrQx3RM9HDajGwP1bdkMqatSdPQrQYtpi2gXGos-Fse356nywP5btdk9E6k6K5BB6nT6CDAXyrTVBnWrFsrwgRlbf1eG0VnMdKPJOTWJ9z6bXd9IY Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: eb983cfa7dfe47b19a0a2d5ba652dabb Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-VolumesActionsTest-212774216 Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 12:51:23.516120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 12:51:23.517754 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb983cfa7dfe47b19a0a2d5ba652dabb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb983cfa7dfe47b19a0a2d5ba652dabb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb983cfa7dfe47b19a0a2d5ba652dabb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb983cfa7dfe47b19a0a2d5ba652dabb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:51:23.517754 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-VolumesActionsTest-212774216 Oct 03 12:51:23.517754 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: eb983cfa7dfe47b19a0a2d5ba652dabb Oct 03 12:51:23.517754 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-VolumesActionsTest-212774216 Oct 03 12:51:23.517754 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-VolumesActionsTest-212774216-project Oct 03 12:51:23.517754 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 12:51:23.517754 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 12:51:23.517754 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: 78b322344df24e8ca513c19361b79257 Oct 03 12:51:23.517754 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-VolumesActionsTest-212774216-project Oct 03 12:51:23.517754 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 12:51:23.517754 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Instance 91b5ec8a-b6d4-433c-9ec0-960af447bbf4 could not be found. Oct 03 12:51:23.517754 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': '91b5ec8a-b6d4-433c-9ec0-960af447bbf4'} Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b5ec8a-b6d4-433c-9ec0-960af447bbf4 could not be found. Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:51:23.518752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b5ec8a-b6d4-433c-9ec0-960af447bbf4 could not be found. Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b5ec8a-b6d4-433c-9ec0-960af447bbf4 could not be found. Oct 03 12:51:23.520039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:51:23.521354 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-fcb63f63-a032-4ee2-a0ca-6d6c92011055 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Returning 404 to user: Instance 91b5ec8a-b6d4-433c-9ec0-960af447bbf4 could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:51:23.521354 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-fcb63f63-a032-4ee2-a0ca-6d6c92011055 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4" status: 404 len: 111 microversion: 2.1 time: 0.036108 Oct 03 12:51:23.521354 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 118/238] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:23 2022] GET /compute/v2.1/servers/91b5ec8a-b6d4-433c-9ec0-960af447bbf4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:51:23.754212 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-846438559", "imageRef": "9d585789-e496-433d-b311-70ec7ceffd99", "flavorRef": "452", "networks": [{"uuid": "df9ed0db-b693-4022-818d-ff2821fbd347"}]}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:51:23.779943 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2c9a5141-1c66-4dc5-90f9-60fc1f38a62b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:23.780691 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2c9a5141-1c66-4dc5-90f9-60fc1f38a62b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:23.787945 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2c9a5141-1c66-4dc5-90f9-60fc1f38a62b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:23.788474 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2c9a5141-1c66-4dc5-90f9-60fc1f38a62b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:23.788922 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2c9a5141-1c66-4dc5-90f9-60fc1f38a62b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:23.789626 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2c9a5141-1c66-4dc5-90f9-60fc1f38a62b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:23.790078 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2c9a5141-1c66-4dc5-90f9-60fc1f38a62b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:23.790502 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2c9a5141-1c66-4dc5-90f9-60fc1f38a62b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:23.808706 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.network.neutron [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] validate_networks() for [('df9ed0db-b693-4022-818d-ff2821fbd347', None, None, None, None, None)] {{(pid=127542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:51:24.013094 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2c9a5141-1c66-4dc5-90f9-60fc1f38a62b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:24.022105 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-2c9a5141-1c66-4dc5-90f9-60fc1f38a62b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.245939 Oct 03 12:51:24.022684 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 119/239] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:23 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:24.237627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Flavor limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:51:24.238502 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Image limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:51:24.238694 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Flavor pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:51:24.239100 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Image pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:51:24.239558 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:51:24.248885 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:24.249368 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:24.251904 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:24.251904 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:24.251904 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:24.251904 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:24.267897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Getting quotas for project eb983cfa7dfe47b19a0a2d5ba652dabb. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:51:24.272511 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Getting quotas for user 78b322344df24e8ca513c19361b79257 and project eb983cfa7dfe47b19a0a2d5ba652dabb. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:51:24.287352 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Going to run 1 instances... {{(pid=127542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:51:24.290201 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d585789-e496-433d-b311-70ec7ceffd99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:51:24.451805 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-7f0c7493-6e1a-4b03-beb8-96421b02864d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701548 Oct 03 12:51:24.452507 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 121/240] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:51:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:51:24.464547 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-7830fb33-a873-4ee4-84d5-a0d4d5669b34 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:24.465506 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-7830fb33-a873-4ee4-84d5-a0d4d5669b34 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:24.527903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7830fb33-a873-4ee4-84d5-a0d4d5669b34 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:24.547467 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-7830fb33-a873-4ee4-84d5-a0d4d5669b34 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1213 microversion: 2.1 time: 0.074162 Oct 03 12:51:24.547467 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 120/241] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:24 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:25.046072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-75f8a11f-bccf-43fa-9965-dcbb9565a89f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:25.046798 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-75f8a11f-bccf-43fa-9965-dcbb9565a89f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:25.055474 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-75f8a11f-bccf-43fa-9965-dcbb9565a89f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:25.055970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-75f8a11f-bccf-43fa-9965-dcbb9565a89f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:25.056509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-75f8a11f-bccf-43fa-9965-dcbb9565a89f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:25.057211 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-75f8a11f-bccf-43fa-9965-dcbb9565a89f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:25.057672 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-75f8a11f-bccf-43fa-9965-dcbb9565a89f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:25.058103 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-75f8a11f-bccf-43fa-9965-dcbb9565a89f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:25.192205 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-75f8a11f-bccf-43fa-9965-dcbb9565a89f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:25.199885 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-75f8a11f-bccf-43fa-9965-dcbb9565a89f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.158231 Oct 03 12:51:25.200449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 122/242] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:25 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:25.560308 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e4ab8638-596c-47da-bb91-a44dcba755ba tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:25.560924 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-e4ab8638-596c-47da-bb91-a44dcba755ba tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:25.567677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e4ab8638-596c-47da-bb91-a44dcba755ba tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:25.568169 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e4ab8638-596c-47da-bb91-a44dcba755ba tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:25.568612 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e4ab8638-596c-47da-bb91-a44dcba755ba tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:25.569307 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e4ab8638-596c-47da-bb91-a44dcba755ba tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:25.569766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e4ab8638-596c-47da-bb91-a44dcba755ba tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:25.570194 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e4ab8638-596c-47da-bb91-a44dcba755ba tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:25.632329 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e4ab8638-596c-47da-bb91-a44dcba755ba tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:25.639774 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e4ab8638-596c-47da-bb91-a44dcba755ba tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1217 microversion: 2.1 time: 0.083290 Oct 03 12:51:25.640335 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 121/243] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:25 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:26.221991 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3d529117-76ed-48a5-91f0-944913a48401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:26.223182 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3d529117-76ed-48a5-91f0-944913a48401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:26.236507 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3d529117-76ed-48a5-91f0-944913a48401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:26.236507 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3d529117-76ed-48a5-91f0-944913a48401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:26.236507 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3d529117-76ed-48a5-91f0-944913a48401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:26.236507 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3d529117-76ed-48a5-91f0-944913a48401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:26.236927 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3d529117-76ed-48a5-91f0-944913a48401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:26.236927 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3d529117-76ed-48a5-91f0-944913a48401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:26.369393 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3d529117-76ed-48a5-91f0-944913a48401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:26.376229 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3d529117-76ed-48a5-91f0-944913a48401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.157950 Oct 03 12:51:26.376792 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 123/244] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:26 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:26.662058 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8e239d86-13d8-4435-b4fb-782641ea2ef4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:26.662673 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8e239d86-13d8-4435-b4fb-782641ea2ef4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:26.668954 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e239d86-13d8-4435-b4fb-782641ea2ef4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:26.669432 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e239d86-13d8-4435-b4fb-782641ea2ef4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:26.670036 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e239d86-13d8-4435-b4fb-782641ea2ef4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:26.670719 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e239d86-13d8-4435-b4fb-782641ea2ef4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:26.671168 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e239d86-13d8-4435-b4fb-782641ea2ef4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:26.671614 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e239d86-13d8-4435-b4fb-782641ea2ef4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:26.736552 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8e239d86-13d8-4435-b4fb-782641ea2ef4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:26.744613 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-8e239d86-13d8-4435-b4fb-782641ea2ef4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1265 microversion: 2.1 time: 0.086552 Oct 03 12:51:26.745172 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 122/245] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:26 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:27.399726 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-28c373c9-9165-40a6-b46c-5282f2cd0842 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:27.400340 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-28c373c9-9165-40a6-b46c-5282f2cd0842 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:27.406549 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-28c373c9-9165-40a6-b46c-5282f2cd0842 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:27.407014 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-28c373c9-9165-40a6-b46c-5282f2cd0842 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:27.407487 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-28c373c9-9165-40a6-b46c-5282f2cd0842 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:27.408173 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-28c373c9-9165-40a6-b46c-5282f2cd0842 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:27.408631 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-28c373c9-9165-40a6-b46c-5282f2cd0842 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:27.409050 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-28c373c9-9165-40a6-b46c-5282f2cd0842 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:27.557366 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-28c373c9-9165-40a6-b46c-5282f2cd0842 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:27.565604 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-28c373c9-9165-40a6-b46c-5282f2cd0842 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.169795 Oct 03 12:51:27.566725 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 124/246] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:27 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:27.767688 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-cbd99d92-4776-48cf-b90e-e1386d551145 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:27.768340 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-cbd99d92-4776-48cf-b90e-e1386d551145 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:27.775013 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cbd99d92-4776-48cf-b90e-e1386d551145 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:27.775550 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cbd99d92-4776-48cf-b90e-e1386d551145 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:27.775986 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cbd99d92-4776-48cf-b90e-e1386d551145 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:27.776680 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cbd99d92-4776-48cf-b90e-e1386d551145 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:27.777135 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cbd99d92-4776-48cf-b90e-e1386d551145 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:27.777559 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cbd99d92-4776-48cf-b90e-e1386d551145 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:27.976519 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-cbd99d92-4776-48cf-b90e-e1386d551145 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:27.984357 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-cbd99d92-4776-48cf-b90e-e1386d551145 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1265 microversion: 2.1 time: 0.220422 Oct 03 12:51:27.984917 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 123/247] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:27 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:28.589118 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-59c24c1b-fbbd-4fb2-bdc3-74558398e292 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:28.589660 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-59c24c1b-fbbd-4fb2-bdc3-74558398e292 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:28.596076 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-59c24c1b-fbbd-4fb2-bdc3-74558398e292 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:28.596557 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-59c24c1b-fbbd-4fb2-bdc3-74558398e292 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:28.597059 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-59c24c1b-fbbd-4fb2-bdc3-74558398e292 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:28.598741 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-59c24c1b-fbbd-4fb2-bdc3-74558398e292 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:28.599201 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-59c24c1b-fbbd-4fb2-bdc3-74558398e292 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:28.599654 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-59c24c1b-fbbd-4fb2-bdc3-74558398e292 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:28.725588 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-59c24c1b-fbbd-4fb2-bdc3-74558398e292 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:28.733203 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-59c24c1b-fbbd-4fb2-bdc3-74558398e292 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.148010 Oct 03 12:51:28.733774 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 125/248] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:28 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:29.008995 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-02b35b81-779f-411d-931b-e560c008cbe2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:29.009603 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-02b35b81-779f-411d-931b-e560c008cbe2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:29.015450 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02b35b81-779f-411d-931b-e560c008cbe2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:29.015934 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02b35b81-779f-411d-931b-e560c008cbe2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:29.016366 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02b35b81-779f-411d-931b-e560c008cbe2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:29.017048 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02b35b81-779f-411d-931b-e560c008cbe2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:29.017493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02b35b81-779f-411d-931b-e560c008cbe2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:29.017916 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02b35b81-779f-411d-931b-e560c008cbe2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:29.077730 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-02b35b81-779f-411d-931b-e560c008cbe2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:29.086129 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-02b35b81-779f-411d-931b-e560c008cbe2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1265 microversion: 2.1 time: 0.080979 Oct 03 12:51:29.086689 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 124/249] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:29 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:51:29.756294 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-07765838-fef8-49d3-a488-c5156d7732b8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:29.756933 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-07765838-fef8-49d3-a488-c5156d7732b8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:29.763851 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-07765838-fef8-49d3-a488-c5156d7732b8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:29.764418 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-07765838-fef8-49d3-a488-c5156d7732b8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:29.764859 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-07765838-fef8-49d3-a488-c5156d7732b8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:29.765600 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-07765838-fef8-49d3-a488-c5156d7732b8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:29.766768 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-07765838-fef8-49d3-a488-c5156d7732b8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:29.767269 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-07765838-fef8-49d3-a488-c5156d7732b8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:29.912873 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-07765838-fef8-49d3-a488-c5156d7732b8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:29.920812 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-07765838-fef8-49d3-a488-c5156d7732b8 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.168527 Oct 03 12:51:29.921370 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 126/250] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:29 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:30.108674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0408f61c-ab16-441f-a5b8-9c43fd66497b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:30.109230 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-0408f61c-ab16-441f-a5b8-9c43fd66497b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:30.117123 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0408f61c-ab16-441f-a5b8-9c43fd66497b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:30.118002 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0408f61c-ab16-441f-a5b8-9c43fd66497b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:30.118594 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0408f61c-ab16-441f-a5b8-9c43fd66497b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:30.119886 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0408f61c-ab16-441f-a5b8-9c43fd66497b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:30.120346 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0408f61c-ab16-441f-a5b8-9c43fd66497b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:30.121348 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0408f61c-ab16-441f-a5b8-9c43fd66497b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:30.188245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0408f61c-ab16-441f-a5b8-9c43fd66497b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:30.196617 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0408f61c-ab16-441f-a5b8-9c43fd66497b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1273 microversion: 2.1 time: 0.091629 Oct 03 12:51:30.206478 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 125/251] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:30 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:30.948609 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-fd30ea57-b459-44ff-a2b1-69b29a32e876 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:30.949227 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-fd30ea57-b459-44ff-a2b1-69b29a32e876 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:30.955594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd30ea57-b459-44ff-a2b1-69b29a32e876 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:30.956347 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd30ea57-b459-44ff-a2b1-69b29a32e876 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:30.957481 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd30ea57-b459-44ff-a2b1-69b29a32e876 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:30.958946 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd30ea57-b459-44ff-a2b1-69b29a32e876 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:30.960036 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd30ea57-b459-44ff-a2b1-69b29a32e876 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:30.960813 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd30ea57-b459-44ff-a2b1-69b29a32e876 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:31.107767 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-fd30ea57-b459-44ff-a2b1-69b29a32e876 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:31.134923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-fd30ea57-b459-44ff-a2b1-69b29a32e876 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.171550 Oct 03 12:51:31.134923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 127/252] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:30 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:31.227192 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-77075e46-1a43-465f-a01b-c8030875827b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:31.228616 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-77075e46-1a43-465f-a01b-c8030875827b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:31.242942 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-77075e46-1a43-465f-a01b-c8030875827b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:31.242942 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-77075e46-1a43-465f-a01b-c8030875827b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:31.242942 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-77075e46-1a43-465f-a01b-c8030875827b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:31.242942 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-77075e46-1a43-465f-a01b-c8030875827b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:31.243245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-77075e46-1a43-465f-a01b-c8030875827b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:31.243245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-77075e46-1a43-465f-a01b-c8030875827b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:31.446220 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-77075e46-1a43-465f-a01b-c8030875827b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:31.457519 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-77075e46-1a43-465f-a01b-c8030875827b tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1313 microversion: 2.1 time: 0.234837 Oct 03 12:51:31.469241 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 126/253] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:31 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:32.066559 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-1b69d335-38b0-467a-917b-c4eaa023c979 req-d0e815b1-ca14-40d8-b384-5bc89566d020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f25ca40b-7241-41b9-8a8b-8e19a3bc14b2", "tag": "01735561-0af5-445a-b8c8-4842dba74030"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:51:32.076205 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-1b69d335-38b0-467a-917b-c4eaa023c979 req-d0e815b1-ca14-40d8-b384-5bc89566d020 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:32.076687 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-1b69d335-38b0-467a-917b-c4eaa023c979 req-d0e815b1-ca14-40d8-b384-5bc89566d020 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:32.077120 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-1b69d335-38b0-467a-917b-c4eaa023c979 req-d0e815b1-ca14-40d8-b384-5bc89566d020 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:32.089884 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-1b69d335-38b0-467a-917b-c4eaa023c979 req-d0e815b1-ca14-40d8-b384-5bc89566d020 service nova] Creating event network-changed:01735561-0af5-445a-b8c8-4842dba74030 for instance f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 on hv-cinder-84456 Oct 03 12:51:32.094835 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-1b69d335-38b0-467a-917b-c4eaa023c979 req-d0e815b1-ca14-40d8-b384-5bc89566d020 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031884 Oct 03 12:51:32.095634 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 128/254] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:51:32.141660 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-dc15ec42-0625-433c-9034-e6e144c00070 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:32.142632 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-dc15ec42-0625-433c-9034-e6e144c00070 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:32.148597 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dc15ec42-0625-433c-9034-e6e144c00070 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:32.149081 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dc15ec42-0625-433c-9034-e6e144c00070 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:32.149516 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dc15ec42-0625-433c-9034-e6e144c00070 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:32.150473 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dc15ec42-0625-433c-9034-e6e144c00070 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:32.150925 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dc15ec42-0625-433c-9034-e6e144c00070 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:32.151596 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dc15ec42-0625-433c-9034-e6e144c00070 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:32.167118 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=100 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:32.293949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-dc15ec42-0625-433c-9034-e6e144c00070 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:32.303568 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-dc15ec42-0625-433c-9034-e6e144c00070 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.165458 Oct 03 12:51:32.307350 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 127/255] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:32 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:32.482515 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8c78d791-d080-4e49-89b2-d7a6643d07c4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:32.483756 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8c78d791-d080-4e49-89b2-d7a6643d07c4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:32.491515 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c78d791-d080-4e49-89b2-d7a6643d07c4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:32.492265 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c78d791-d080-4e49-89b2-d7a6643d07c4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:32.493216 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c78d791-d080-4e49-89b2-d7a6643d07c4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:32.494977 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c78d791-d080-4e49-89b2-d7a6643d07c4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:32.495705 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c78d791-d080-4e49-89b2-d7a6643d07c4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:32.496377 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c78d791-d080-4e49-89b2-d7a6643d07c4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:32.680486 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8c78d791-d080-4e49-89b2-d7a6643d07c4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:32.689315 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8c78d791-d080-4e49-89b2-d7a6643d07c4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1313 microversion: 2.1 time: 0.210885 Oct 03 12:51:32.690462 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 129/256] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:32 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:33.330618 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-cac856be-d81a-450d-8280-57eddd50f401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:33.331620 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-cac856be-d81a-450d-8280-57eddd50f401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:33.337694 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cac856be-d81a-450d-8280-57eddd50f401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:33.338249 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cac856be-d81a-450d-8280-57eddd50f401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:33.345919 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cac856be-d81a-450d-8280-57eddd50f401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:33.345919 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cac856be-d81a-450d-8280-57eddd50f401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:33.345919 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cac856be-d81a-450d-8280-57eddd50f401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:33.345919 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cac856be-d81a-450d-8280-57eddd50f401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:33.648183 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-cac856be-d81a-450d-8280-57eddd50f401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:33.682293 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-cac856be-d81a-450d-8280-57eddd50f401 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.344112 Oct 03 12:51:33.683729 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 128/257] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:33 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:33.726971 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f642f988-2df2-4d55-8312-bc659c5aa39f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:33.743178 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f642f988-2df2-4d55-8312-bc659c5aa39f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:33.750742 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f642f988-2df2-4d55-8312-bc659c5aa39f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:33.751932 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f642f988-2df2-4d55-8312-bc659c5aa39f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:33.752388 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f642f988-2df2-4d55-8312-bc659c5aa39f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:33.753141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f642f988-2df2-4d55-8312-bc659c5aa39f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:33.754258 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f642f988-2df2-4d55-8312-bc659c5aa39f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:33.755031 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f642f988-2df2-4d55-8312-bc659c5aa39f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:33.927776 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-f642f988-2df2-4d55-8312-bc659c5aa39f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:33.938654 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f642f988-2df2-4d55-8312-bc659c5aa39f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1313 microversion: 2.1 time: 0.217992 Oct 03 12:51:33.939337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 130/258] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:33 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:34.711369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-408ab179-b1b5-4a5e-9edb-383961f7a813 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:34.712487 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-408ab179-b1b5-4a5e-9edb-383961f7a813 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:34.715256 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=2 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:34.720390 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-408ab179-b1b5-4a5e-9edb-383961f7a813 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:34.720893 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-408ab179-b1b5-4a5e-9edb-383961f7a813 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:34.721372 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-408ab179-b1b5-4a5e-9edb-383961f7a813 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:34.722200 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-408ab179-b1b5-4a5e-9edb-383961f7a813 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:34.723760 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-408ab179-b1b5-4a5e-9edb-383961f7a813 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:34.724203 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-408ab179-b1b5-4a5e-9edb-383961f7a813 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:34.964084 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-408ab179-b1b5-4a5e-9edb-383961f7a813 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:34.966368 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8831760b-22f6-4759-a040-d2d5753723dc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:34.967614 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8831760b-22f6-4759-a040-d2d5753723dc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:34.973017 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:34.973808 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=6 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:34.977246 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-408ab179-b1b5-4a5e-9edb-383961f7a813 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1502 microversion: 2.1 time: 0.270875 Oct 03 12:51:34.977395 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8831760b-22f6-4759-a040-d2d5753723dc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:34.977838 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8831760b-22f6-4759-a040-d2d5753723dc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:34.977993 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 129/259] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:34 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1502 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:34.979750 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8831760b-22f6-4759-a040-d2d5753723dc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:34.980943 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8831760b-22f6-4759-a040-d2d5753723dc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:34.981706 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8831760b-22f6-4759-a040-d2d5753723dc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:34.982281 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8831760b-22f6-4759-a040-d2d5753723dc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:35.001678 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-93ac0ab7-ee1b-42b8-b85c-cc492bf02935 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b100e00a-685a-4be4-bae0-4b5833c7d716"}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:51:35.004930 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-93ac0ab7-ee1b-42b8-b85c-cc492bf02935 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:35.012098 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-93ac0ab7-ee1b-42b8-b85c-cc492bf02935 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:35.012723 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-93ac0ab7-ee1b-42b8-b85c-cc492bf02935 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:35.013364 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-93ac0ab7-ee1b-42b8-b85c-cc492bf02935 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:35.014294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-93ac0ab7-ee1b-42b8-b85c-cc492bf02935 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:35.014761 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-93ac0ab7-ee1b-42b8-b85c-cc492bf02935 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:35.015193 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-93ac0ab7-ee1b-42b8-b85c-cc492bf02935 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:35.044951 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-93ac0ab7-ee1b-42b8-b85c-cc492bf02935 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] HTTP exception thrown: Cannot 'attach_volume' instance f9909a9d-feb5-4513-9e14-6aadc4e17c59 while it is in vm_state rescued Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-93ac0ab7-ee1b-42b8-b85c-cc492bf02935 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Request method failure captured: Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: POST /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59/os-volume_attachments HTTP/1.1 Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 74 Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtpg_jSSVskjPk1vj2hB6kFIFqzmNhwYwmbqVtDtVEm_DCGqJp2bI-HTYHdXoVGxmBUvfojEda8t7ahZxu3oZUxrCi0M81LTwRQ1oj9rh78tD7KDuQLShxe9wj1rzH1fQcVA6c-lh1vZH84HHzjmTQfelEBPR3ibYOhBaZo555opZQM Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: 3f2b18d217d14d39886718cf209eb576 Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103094266 Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 12:51:35.046769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 12:51:35.048253 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f2b18d217d14d39886718cf209eb576"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f2b18d217d14d39886718cf209eb576"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f2b18d217d14d39886718cf209eb576"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f2b18d217d14d39886718cf209eb576"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:51:35.048253 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103094266 Oct 03 12:51:35.048253 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: 3f2b18d217d14d39886718cf209eb576 Oct 03 12:51:35.048253 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103094266 Oct 03 12:51:35.048253 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-ServerRescueNegativeTestJSON-1103094266-project Oct 03 12:51:35.048253 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 12:51:35.048253 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 12:51:35.048253 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: ad5654cfa65f4cfa9e68832b9cd3d129 Oct 03 12:51:35.048253 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103094266-project Oct 03 12:51:35.048253 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Oct 03 12:51:35.048253 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {"volumeAttachment": {"volumeId": "b100e00a-685a-4be4-bae0-4b5833c7d716"}} Oct 03 12:51:35.048253 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Cannot 'attach_volume' instance f9909a9d-feb5-4513-9e14-6aadc4e17c59 while it is in vm_state rescued Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'server_id': 'f9909a9d-feb5-4513-9e14-6aadc4e17c59', 'body': {'volumeAttachment': {'volumeId': 'b100e00a-685a-4be4-bae0-4b5833c7d716'}}} Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f9909a9d-feb5-4513-9e14-6aadc4e17c59 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:51:35.048927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f9909a9d-feb5-4513-9e14-6aadc4e17c59 while it is in vm_state rescued Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:51:35.050269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:51:35.051466 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:51:35.051466 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:51:35.051466 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f9909a9d-feb5-4513-9e14-6aadc4e17c59 while it is in vm_state rescued Oct 03 12:51:35.051466 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:51:35.051466 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-93ac0ab7-ee1b-42b8-b85c-cc492bf02935 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Returning 409 to user: Cannot 'attach_volume' instance f9909a9d-feb5-4513-9e14-6aadc4e17c59 while it is in vm_state rescued {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:51:35.051466 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-93ac0ab7-ee1b-42b8-b85c-cc492bf02935 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "POST /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051430 Oct 03 12:51:35.052772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 130/260] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 12:51:34 2022] POST /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59/os-volume_attachments => generated 152 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 03 12:51:35.057727 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ca65f5d4-27e0-4064-b653-8bf9c9423136 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:51:35.058462 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ca65f5d4-27e0-4064-b653-8bf9c9423136 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:35.064324 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ca65f5d4-27e0-4064-b653-8bf9c9423136 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:35.064809 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ca65f5d4-27e0-4064-b653-8bf9c9423136 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:35.065251 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ca65f5d4-27e0-4064-b653-8bf9c9423136 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:35.066129 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ca65f5d4-27e0-4064-b653-8bf9c9423136 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:35.067143 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ca65f5d4-27e0-4064-b653-8bf9c9423136 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:35.067778 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ca65f5d4-27e0-4064-b653-8bf9c9423136 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:35.178179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8831760b-22f6-4759-a040-d2d5753723dc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:35.187415 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8831760b-22f6-4759-a040-d2d5753723dc tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1313 microversion: 2.1 time: 0.226129 Oct 03 12:51:35.188002 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 131/261] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:34 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:51:35.356924 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ca65f5d4-27e0-4064-b653-8bf9c9423136 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "POST /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59/action" status: 202 len: 0 microversion: 2.1 time: 0.302697 Oct 03 12:51:35.357911 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 131/262] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 12:51:35 2022] POST /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:51:35.373422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-67d60330-a918-482d-8bdc-b0a4fd8372f4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:35.381075 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-67d60330-a918-482d-8bdc-b0a4fd8372f4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:35.395485 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-67d60330-a918-482d-8bdc-b0a4fd8372f4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:35.400798 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-67d60330-a918-482d-8bdc-b0a4fd8372f4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:35.401516 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-67d60330-a918-482d-8bdc-b0a4fd8372f4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:35.402450 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-67d60330-a918-482d-8bdc-b0a4fd8372f4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:35.404589 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-67d60330-a918-482d-8bdc-b0a4fd8372f4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:35.405253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-67d60330-a918-482d-8bdc-b0a4fd8372f4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:35.415673 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=100 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:35.597397 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-67d60330-a918-482d-8bdc-b0a4fd8372f4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:35.608109 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-67d60330-a918-482d-8bdc-b0a4fd8372f4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1510 microversion: 2.1 time: 0.242607 Oct 03 12:51:35.608853 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 132/263] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:35 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:36.213707 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-4bc913ca-20cc-4d9a-80ad-d9bc642d7d9d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:36.214317 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-4bc913ca-20cc-4d9a-80ad-d9bc642d7d9d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:36.220608 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4bc913ca-20cc-4d9a-80ad-d9bc642d7d9d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:36.221084 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4bc913ca-20cc-4d9a-80ad-d9bc642d7d9d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:36.221518 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4bc913ca-20cc-4d9a-80ad-d9bc642d7d9d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:36.222199 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4bc913ca-20cc-4d9a-80ad-d9bc642d7d9d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:36.222672 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4bc913ca-20cc-4d9a-80ad-d9bc642d7d9d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:36.224007 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4bc913ca-20cc-4d9a-80ad-d9bc642d7d9d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:36.376290 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4bc913ca-20cc-4d9a-80ad-d9bc642d7d9d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:36.385736 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-4bc913ca-20cc-4d9a-80ad-d9bc642d7d9d tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1313 microversion: 2.1 time: 0.176368 Oct 03 12:51:36.386687 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 132/264] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:36 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:36.633457 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-72132115-660c-472c-8db4-db3decfc6214 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:36.634099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-72132115-660c-472c-8db4-db3decfc6214 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:36.641245 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-72132115-660c-472c-8db4-db3decfc6214 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:36.641738 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-72132115-660c-472c-8db4-db3decfc6214 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:36.642184 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-72132115-660c-472c-8db4-db3decfc6214 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:36.642889 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-72132115-660c-472c-8db4-db3decfc6214 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:36.643365 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-72132115-660c-472c-8db4-db3decfc6214 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:36.643799 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-72132115-660c-472c-8db4-db3decfc6214 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:36.772621 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0db7808b-f553-4780-b0e0-ce50b18c4dd5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:36.773264 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-0db7808b-f553-4780-b0e0-ce50b18c4dd5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:36.777280 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-72132115-660c-472c-8db4-db3decfc6214 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:36.784896 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0db7808b-f553-4780-b0e0-ce50b18c4dd5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:36.785999 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0db7808b-f553-4780-b0e0-ce50b18c4dd5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:36.788055 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0db7808b-f553-4780-b0e0-ce50b18c4dd5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:36.788785 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0db7808b-f553-4780-b0e0-ce50b18c4dd5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:36.789285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0db7808b-f553-4780-b0e0-ce50b18c4dd5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:36.789668 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0db7808b-f553-4780-b0e0-ce50b18c4dd5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:36.798820 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-72132115-660c-472c-8db4-db3decfc6214 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1510 microversion: 2.1 time: 0.169385 Oct 03 12:51:36.799438 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 133/265] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:36 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:36.829185 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0db7808b-f553-4780-b0e0-ce50b18c4dd5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/ips" status: 200 len: 146 microversion: 2.1 time: 0.061049 Oct 03 12:51:36.830398 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 133/266] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 12:51:36 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/ips => generated 146 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:51:37.412669 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-78b565ca-50ab-4df9-918c-d4f63fa43ff2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:37.413499 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-78b565ca-50ab-4df9-918c-d4f63fa43ff2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:37.421508 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-78b565ca-50ab-4df9-918c-d4f63fa43ff2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:37.422147 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-78b565ca-50ab-4df9-918c-d4f63fa43ff2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:37.422692 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-78b565ca-50ab-4df9-918c-d4f63fa43ff2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:37.423839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-78b565ca-50ab-4df9-918c-d4f63fa43ff2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:37.424403 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-78b565ca-50ab-4df9-918c-d4f63fa43ff2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:37.424977 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-78b565ca-50ab-4df9-918c-d4f63fa43ff2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:37.642504 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-78b565ca-50ab-4df9-918c-d4f63fa43ff2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:37.650641 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-78b565ca-50ab-4df9-918c-d4f63fa43ff2 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1313 microversion: 2.1 time: 0.244306 Oct 03 12:51:37.651226 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 134/267] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:37 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:37.826077 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-67c84111-6cb3-4790-b04b-b3e4f87a6b9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:37.826689 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-67c84111-6cb3-4790-b04b-b3e4f87a6b9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:37.833148 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67c84111-6cb3-4790-b04b-b3e4f87a6b9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:37.833682 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67c84111-6cb3-4790-b04b-b3e4f87a6b9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:37.834299 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67c84111-6cb3-4790-b04b-b3e4f87a6b9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:37.835249 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67c84111-6cb3-4790-b04b-b3e4f87a6b9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:37.835908 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67c84111-6cb3-4790-b04b-b3e4f87a6b9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:37.836723 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67c84111-6cb3-4790-b04b-b3e4f87a6b9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:38.049636 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-67c84111-6cb3-4790-b04b-b3e4f87a6b9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:38.061202 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-67c84111-6cb3-4790-b04b-b3e4f87a6b9b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1510 microversion: 2.1 time: 0.238708 Oct 03 12:51:38.061889 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 134/268] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:37 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:38.678287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b20b249b-41cc-4d84-9795-63b3fe6f92de tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:38.678972 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b20b249b-41cc-4d84-9795-63b3fe6f92de tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:38.693635 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b20b249b-41cc-4d84-9795-63b3fe6f92de tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:38.694473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b20b249b-41cc-4d84-9795-63b3fe6f92de tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:38.695131 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b20b249b-41cc-4d84-9795-63b3fe6f92de tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:38.696402 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b20b249b-41cc-4d84-9795-63b3fe6f92de tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:38.698340 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b20b249b-41cc-4d84-9795-63b3fe6f92de tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:38.708018 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b20b249b-41cc-4d84-9795-63b3fe6f92de tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:38.963123 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-b20b249b-41cc-4d84-9795-63b3fe6f92de tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:38.980363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-b20b249b-41cc-4d84-9795-63b3fe6f92de tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1313 microversion: 2.1 time: 0.307966 Oct 03 12:51:38.981197 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 135/269] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:38 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:39.084857 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9cc7f02b-b5dd-428a-84a7-9b08c6b89a81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:39.085985 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-9cc7f02b-b5dd-428a-84a7-9b08c6b89a81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:39.094020 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9cc7f02b-b5dd-428a-84a7-9b08c6b89a81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:39.094676 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9cc7f02b-b5dd-428a-84a7-9b08c6b89a81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:39.095127 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9cc7f02b-b5dd-428a-84a7-9b08c6b89a81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:39.096019 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9cc7f02b-b5dd-428a-84a7-9b08c6b89a81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:39.096629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9cc7f02b-b5dd-428a-84a7-9b08c6b89a81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:39.097587 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9cc7f02b-b5dd-428a-84a7-9b08c6b89a81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:39.276623 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9cc7f02b-b5dd-428a-84a7-9b08c6b89a81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:39.284656 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-9cc7f02b-b5dd-428a-84a7-9b08c6b89a81 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1516 microversion: 2.1 time: 0.204123 Oct 03 12:51:39.285372 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 135/270] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:39 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1516 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:40.006827 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c3ae223f-8868-46ad-8b78-9056d483793c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:40.007550 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c3ae223f-8868-46ad-8b78-9056d483793c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:40.026806 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c3ae223f-8868-46ad-8b78-9056d483793c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:40.027601 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c3ae223f-8868-46ad-8b78-9056d483793c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:40.028223 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c3ae223f-8868-46ad-8b78-9056d483793c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:40.029084 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c3ae223f-8868-46ad-8b78-9056d483793c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:40.029730 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c3ae223f-8868-46ad-8b78-9056d483793c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:40.030302 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c3ae223f-8868-46ad-8b78-9056d483793c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:40.421566 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-1345f991-8858-4fb3-bb6b-53fd22ecc69b req-af15022d-00f4-4c49-98ac-680dddaeced4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f25ca40b-7241-41b9-8a8b-8e19a3bc14b2", "name": "network-vif-plugged", "status": "completed", "tag": "01735561-0af5-445a-b8c8-4842dba74030"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:51:40.459177 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:40.459177 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-1345f991-8858-4fb3-bb6b-53fd22ecc69b req-af15022d-00f4-4c49-98ac-680dddaeced4 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:40.459177 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-1345f991-8858-4fb3-bb6b-53fd22ecc69b req-af15022d-00f4-4c49-98ac-680dddaeced4 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:40.459177 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-1345f991-8858-4fb3-bb6b-53fd22ecc69b req-af15022d-00f4-4c49-98ac-680dddaeced4 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:40.465550 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-1345f991-8858-4fb3-bb6b-53fd22ecc69b req-af15022d-00f4-4c49-98ac-680dddaeced4 service nova] Creating event network-vif-plugged:01735561-0af5-445a-b8c8-4842dba74030 for instance f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 on hv-cinder-84456 Oct 03 12:51:40.472035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-1345f991-8858-4fb3-bb6b-53fd22ecc69b req-af15022d-00f4-4c49-98ac-680dddaeced4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054430 Oct 03 12:51:40.474767 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 136/271] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:51:40.616143 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c3ae223f-8868-46ad-8b78-9056d483793c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:40.625060 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c3ae223f-8868-46ad-8b78-9056d483793c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1313 microversion: 2.1 time: 0.623544 Oct 03 12:51:40.625642 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 136/272] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:40 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:41.241793 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-91e174f0-6bc0-4157-8fb8-3d510ba0bdc4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Action: 'create', calling method: .version_select at 0x7fc7403d3550>, body: {"keypair": {"name": "tempest-keypair-1762024792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0i3onhD8DurpAevoHhnm+F2w8HbyjzcXxP08zurtoM0cSUIcicTBflUyuZzJSLdd9FEjad+qNDYpJyBJ/XCBHwIcWitgrl+OMK8TxonRmxngsL9AOdV2/rHAjOju68sA=="}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:51:41.274908 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-91e174f0-6bc0-4157-8fb8-3d510ba0bdc4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Getting quotas for project 3f2b18d217d14d39886718cf209eb576. Resources: {'key_pairs'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:51:41.279999 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-91e174f0-6bc0-4157-8fb8-3d510ba0bdc4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Getting quotas for user ad5654cfa65f4cfa9e68832b9cd3d129 and project 3f2b18d217d14d39886718cf209eb576. Resources: {'key_pairs'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:51:41.366459 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-91e174f0-6bc0-4157-8fb8-3d510ba0bdc4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130143 Oct 03 12:51:41.374165 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 137/273] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 12:51:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:51:41.651454 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3c2f35fe-6997-4c96-9ca4-f2f447fb8c70 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:41.664566 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3c2f35fe-6997-4c96-9ca4-f2f447fb8c70 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:41.670698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c2f35fe-6997-4c96-9ca4-f2f447fb8c70 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:41.671599 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c2f35fe-6997-4c96-9ca4-f2f447fb8c70 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:41.673273 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c2f35fe-6997-4c96-9ca4-f2f447fb8c70 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:41.674195 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c2f35fe-6997-4c96-9ca4-f2f447fb8c70 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:41.674839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c2f35fe-6997-4c96-9ca4-f2f447fb8c70 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:41.675570 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c2f35fe-6997-4c96-9ca4-f2f447fb8c70 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:41.971445 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3c2f35fe-6997-4c96-9ca4-f2f447fb8c70 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:41.989914 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3c2f35fe-6997-4c96-9ca4-f2f447fb8c70 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1313 microversion: 2.1 time: 0.345361 Oct 03 12:51:41.990765 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 137/274] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:41 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:43.015027 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b1f8c65e-6806-49a3-b1d7-c7c11797545f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:43.016119 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-b1f8c65e-6806-49a3-b1d7-c7c11797545f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:43.024696 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b1f8c65e-6806-49a3-b1d7-c7c11797545f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:43.025428 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b1f8c65e-6806-49a3-b1d7-c7c11797545f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:43.026216 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b1f8c65e-6806-49a3-b1d7-c7c11797545f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:43.027108 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b1f8c65e-6806-49a3-b1d7-c7c11797545f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:43.027801 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b1f8c65e-6806-49a3-b1d7-c7c11797545f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:43.028413 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b1f8c65e-6806-49a3-b1d7-c7c11797545f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:43.048141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-dfe85d1f-f27c-45e2-b668-7f27c427496f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77bbfa5a-01a9-426f-9286-b06e95f2b9ec"}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:51:43.052107 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-dfe85d1f-f27c-45e2-b668-7f27c427496f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:43.061351 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dfe85d1f-f27c-45e2-b668-7f27c427496f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:43.062077 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dfe85d1f-f27c-45e2-b668-7f27c427496f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:43.062737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dfe85d1f-f27c-45e2-b668-7f27c427496f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:43.063640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dfe85d1f-f27c-45e2-b668-7f27c427496f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:43.064225 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dfe85d1f-f27c-45e2-b668-7f27c427496f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:43.065055 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-dfe85d1f-f27c-45e2-b668-7f27c427496f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:43.339550 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-b1f8c65e-6806-49a3-b1d7-c7c11797545f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:43.348264 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-b1f8c65e-6806-49a3-b1d7-c7c11797545f tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1313 microversion: 2.1 time: 0.338464 Oct 03 12:51:43.348951 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 138/275] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:43 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:44.022975 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-dfe85d1f-f27c-45e2-b668-7f27c427496f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "POST /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.981407 Oct 03 12:51:44.024339 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 138/276] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 12:51:43 2022] POST /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/os-volume_attachments => generated 194 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:51:44.371203 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-06ef894d-9b1a-40ae-ac74-788321c01c71 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:44.371846 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-06ef894d-9b1a-40ae-ac74-788321c01c71 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:44.381020 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-06ef894d-9b1a-40ae-ac74-788321c01c71 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:44.382019 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-06ef894d-9b1a-40ae-ac74-788321c01c71 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:44.382779 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-06ef894d-9b1a-40ae-ac74-788321c01c71 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:44.383698 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-06ef894d-9b1a-40ae-ac74-788321c01c71 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:44.384303 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-06ef894d-9b1a-40ae-ac74-788321c01c71 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:44.384877 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-06ef894d-9b1a-40ae-ac74-788321c01c71 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:44.571213 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-06ef894d-9b1a-40ae-ac74-788321c01c71 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:44.583964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-06ef894d-9b1a-40ae-ac74-788321c01c71 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1498 microversion: 2.1 time: 0.216673 Oct 03 12:51:44.584970 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 139/277] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:44 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1498 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:44.778844 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-50129949", "imageRef": "9d585789-e496-433d-b311-70ec7ceffd99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f492b9a3-221f-4263-a074-289d6252f405"}], "security_groups": [{"name": "tempest-securitygroup--1371682605"}], "key_name": "tempest-keypair-1762024792", "user_data": "}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:51:44.789246 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:44.909661 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.network.neutron [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] validate_networks() for [('f492b9a3-221f-4263-a074-289d6252f405', None, None, None, None, None)] {{(pid=127542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:51:45.482410 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Flavor limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:51:45.482850 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Image limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:51:45.483348 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Flavor pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:51:45.483765 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Image pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:51:45.484360 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:51:45.502811 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:45.507462 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:45.511162 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:45.511162 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:45.514455 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:45.515262 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:45.559568 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Getting quotas for project 3f2b18d217d14d39886718cf209eb576. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:51:45.567477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Getting quotas for user ad5654cfa65f4cfa9e68832b9cd3d129 and project 3f2b18d217d14d39886718cf209eb576. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:51:45.599427 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Going to run 1 instances... {{(pid=127542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:51:45.606852 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d585789-e496-433d-b311-70ec7ceffd99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:51:45.813524 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-823e333e-c108-405e-b822-8d947a0d1b42 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.038163 Oct 03 12:51:45.819525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 139/278] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:51:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 12:51:45.831151 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0988d52f-6de4-495a-a721-bed4eb148830 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:45.832917 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-0988d52f-6de4-495a-a721-bed4eb148830 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:45.904102 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0988d52f-6de4-495a-a721-bed4eb148830 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:45.914860 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0988d52f-6de4-495a-a721-bed4eb148830 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1244 microversion: 2.1 time: 0.086688 Oct 03 12:51:45.919560 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-355981ce-d6f6-4175-80fb-f2dd0eec11e7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:45.922244 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-355981ce-d6f6-4175-80fb-f2dd0eec11e7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:45.928856 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 140/279] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:45 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1244 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:45.948948 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-355981ce-d6f6-4175-80fb-f2dd0eec11e7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:45.949542 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-355981ce-d6f6-4175-80fb-f2dd0eec11e7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:45.951095 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-355981ce-d6f6-4175-80fb-f2dd0eec11e7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:45.952284 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-355981ce-d6f6-4175-80fb-f2dd0eec11e7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:45.954916 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-355981ce-d6f6-4175-80fb-f2dd0eec11e7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:45.959102 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-355981ce-d6f6-4175-80fb-f2dd0eec11e7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:46.027863 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-355981ce-d6f6-4175-80fb-f2dd0eec11e7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/ips" status: 200 len: 152 microversion: 2.20 time: 0.131395 Oct 03 12:51:46.043147 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 140/280] 10.222.0.33 () {60 vars in 1289 bytes} [Mon Oct 3 12:51:45 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/ips => generated 152 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 12:51:46.754828 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d5a6a7d9-6d1c-403d-b5a9-dc2c196f7986 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:46.755617 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d5a6a7d9-6d1c-403d-b5a9-dc2c196f7986 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:46.773485 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d5a6a7d9-6d1c-403d-b5a9-dc2c196f7986 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:46.774519 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d5a6a7d9-6d1c-403d-b5a9-dc2c196f7986 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:46.780900 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d5a6a7d9-6d1c-403d-b5a9-dc2c196f7986 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:46.783041 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d5a6a7d9-6d1c-403d-b5a9-dc2c196f7986 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:46.787747 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d5a6a7d9-6d1c-403d-b5a9-dc2c196f7986 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:46.788471 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d5a6a7d9-6d1c-403d-b5a9-dc2c196f7986 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:46.830886 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d5a6a7d9-6d1c-403d-b5a9-dc2c196f7986 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Going to try to terminate instance {{(pid=127544) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:51:46.938993 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ea157553-cb47-40a1-a377-2ee2c109be94 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:46.940230 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-ea157553-cb47-40a1-a377-2ee2c109be94 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:47.043526 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-ea157553-cb47-40a1-a377-2ee2c109be94 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:47.050915 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-ea157553-cb47-40a1-a377-2ee2c109be94 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1244 microversion: 2.1 time: 0.116317 Oct 03 12:51:47.051521 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 141/281] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:46 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1244 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:47.205719 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d5a6a7d9-6d1c-403d-b5a9-dc2c196f7986 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 204 len: 0 microversion: 2.1 time: 0.455297 Oct 03 12:51:47.206316 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 141/282] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:51:46 2022] DELETE /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:51:47.215132 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a6f91dbf-f9ff-49e7-815d-66037f5157a4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:47.215788 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a6f91dbf-f9ff-49e7-815d-66037f5157a4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:47.221830 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a6f91dbf-f9ff-49e7-815d-66037f5157a4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:47.222792 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a6f91dbf-f9ff-49e7-815d-66037f5157a4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:47.223641 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a6f91dbf-f9ff-49e7-815d-66037f5157a4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:47.224669 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a6f91dbf-f9ff-49e7-815d-66037f5157a4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:47.225402 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a6f91dbf-f9ff-49e7-815d-66037f5157a4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:47.226421 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a6f91dbf-f9ff-49e7-815d-66037f5157a4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:47.475590 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a6f91dbf-f9ff-49e7-815d-66037f5157a4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:47.493448 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a6f91dbf-f9ff-49e7-815d-66037f5157a4 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1504 microversion: 2.1 time: 0.282164 Oct 03 12:51:47.498995 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 142/283] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:47 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:48.074794 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-48ce7471-5e6c-436c-9a50-a402048e9f97 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:48.075645 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-48ce7471-5e6c-436c-9a50-a402048e9f97 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:48.096268 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-48ce7471-5e6c-436c-9a50-a402048e9f97 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:48.096268 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-48ce7471-5e6c-436c-9a50-a402048e9f97 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:48.096268 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-48ce7471-5e6c-436c-9a50-a402048e9f97 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:48.096268 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-48ce7471-5e6c-436c-9a50-a402048e9f97 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:48.096833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-48ce7471-5e6c-436c-9a50-a402048e9f97 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:48.096833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-48ce7471-5e6c-436c-9a50-a402048e9f97 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:48.194410 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-48ce7471-5e6c-436c-9a50-a402048e9f97 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:48.211532 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-48ce7471-5e6c-436c-9a50-a402048e9f97 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1248 microversion: 2.1 time: 0.132983 Oct 03 12:51:48.211532 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 142/284] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:48 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1248 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:48.525824 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4fa6552e-e22f-4d06-b2f6-6b094c09fe5c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:48.526972 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-4fa6552e-e22f-4d06-b2f6-6b094c09fe5c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:48.536037 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4fa6552e-e22f-4d06-b2f6-6b094c09fe5c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:48.536530 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4fa6552e-e22f-4d06-b2f6-6b094c09fe5c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:48.538013 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4fa6552e-e22f-4d06-b2f6-6b094c09fe5c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:48.538664 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4fa6552e-e22f-4d06-b2f6-6b094c09fe5c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:48.539877 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4fa6552e-e22f-4d06-b2f6-6b094c09fe5c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:48.540465 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4fa6552e-e22f-4d06-b2f6-6b094c09fe5c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:48.779930 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e141bb02-ca51-4860-b2de-576ab879c00f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:51:48.780541 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-e141bb02-ca51-4860-b2de-576ab879c00f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:48.790756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e141bb02-ca51-4860-b2de-576ab879c00f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:48.791256 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e141bb02-ca51-4860-b2de-576ab879c00f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:48.791898 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e141bb02-ca51-4860-b2de-576ab879c00f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:48.792799 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e141bb02-ca51-4860-b2de-576ab879c00f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:48.796453 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e141bb02-ca51-4860-b2de-576ab879c00f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:48.797108 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e141bb02-ca51-4860-b2de-576ab879c00f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:48.830642 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4fa6552e-e22f-4d06-b2f6-6b094c09fe5c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:48.848748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-4fa6552e-e22f-4d06-b2f6-6b094c09fe5c tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1504 microversion: 2.1 time: 0.325962 Oct 03 12:51:48.848748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 143/285] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:48 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:48.857589 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-e141bb02-ca51-4860-b2de-576ab879c00f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lazy-loading 'flavor' on Instance uuid 54982238-81ba-4d23-b642-e3a37f778b4a {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:51:49.017504 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:49.252117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c6190995-97e8-4027-94f1-13eec7f1e121 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:49.252905 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c6190995-97e8-4027-94f1-13eec7f1e121 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:49.275658 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c6190995-97e8-4027-94f1-13eec7f1e121 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:49.276526 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c6190995-97e8-4027-94f1-13eec7f1e121 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:49.277098 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c6190995-97e8-4027-94f1-13eec7f1e121 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:49.278258 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c6190995-97e8-4027-94f1-13eec7f1e121 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:49.278735 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c6190995-97e8-4027-94f1-13eec7f1e121 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:49.279485 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c6190995-97e8-4027-94f1-13eec7f1e121 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:49.388614 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c6190995-97e8-4027-94f1-13eec7f1e121 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:49.402661 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c6190995-97e8-4027-94f1-13eec7f1e121 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1296 microversion: 2.1 time: 0.176894 Oct 03 12:51:49.419568 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 144/286] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:49 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1296 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:49.618138 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e141bb02-ca51-4860-b2de-576ab879c00f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "POST /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/action" status: 202 len: 0 microversion: 2.20 time: 0.842213 Oct 03 12:51:49.623490 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 143/287] 10.222.0.33 () {62 vars in 1319 bytes} [Mon Oct 3 12:51:48 2022] POST /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/action => generated 0 bytes in 849 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:51:49.628910 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-6951a8fe-4689-46cf-bfd2-312d5d82b3af tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:49.631208 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-6951a8fe-4689-46cf-bfd2-312d5d82b3af tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:49.638460 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6951a8fe-4689-46cf-bfd2-312d5d82b3af tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:49.639303 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6951a8fe-4689-46cf-bfd2-312d5d82b3af tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:49.640037 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6951a8fe-4689-46cf-bfd2-312d5d82b3af tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:49.640952 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6951a8fe-4689-46cf-bfd2-312d5d82b3af tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:49.644476 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6951a8fe-4689-46cf-bfd2-312d5d82b3af tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:49.645462 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6951a8fe-4689-46cf-bfd2-312d5d82b3af tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:49.875652 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0128443b-5620-4e38-a8be-fe42179172ea tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:49.877062 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-0128443b-5620-4e38-a8be-fe42179172ea tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:49.888662 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0128443b-5620-4e38-a8be-fe42179172ea tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:49.889488 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0128443b-5620-4e38-a8be-fe42179172ea tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:49.890216 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0128443b-5620-4e38-a8be-fe42179172ea tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:49.891260 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0128443b-5620-4e38-a8be-fe42179172ea tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:49.892427 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0128443b-5620-4e38-a8be-fe42179172ea tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:49.892853 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0128443b-5620-4e38-a8be-fe42179172ea tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:49.943155 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6951a8fe-4689-46cf-bfd2-312d5d82b3af tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:49.974140 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6951a8fe-4689-46cf-bfd2-312d5d82b3af tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:49.977263 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6951a8fe-4689-46cf-bfd2-312d5d82b3af tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:49.982175 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-6951a8fe-4689-46cf-bfd2-312d5d82b3af tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1724 microversion: 2.20 time: 0.355444 Oct 03 12:51:49.983283 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 145/288] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:51:49 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1724 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:51:50.023223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0128443b-5620-4e38-a8be-fe42179172ea tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:50.035919 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0128443b-5620-4e38-a8be-fe42179172ea tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1462 microversion: 2.1 time: 0.167150 Oct 03 12:51:50.043585 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 144/289] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:49 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1462 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:51:50.088968 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-d95c2a18-e1d0-4cb9-9816-898bb4ac7d64 req-8d3b1727-a3ff-49bd-8cec-fbb26fe763d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f25ca40b-7241-41b9-8a8b-8e19a3bc14b2", "name": "network-vif-deleted", "tag": "01735561-0af5-445a-b8c8-4842dba74030"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:51:50.099619 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-d95c2a18-e1d0-4cb9-9816-898bb4ac7d64 req-8d3b1727-a3ff-49bd-8cec-fbb26fe763d7 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:50.100050 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-d95c2a18-e1d0-4cb9-9816-898bb4ac7d64 req-8d3b1727-a3ff-49bd-8cec-fbb26fe763d7 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:50.100483 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-d95c2a18-e1d0-4cb9-9816-898bb4ac7d64 req-8d3b1727-a3ff-49bd-8cec-fbb26fe763d7 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:50.112554 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-d95c2a18-e1d0-4cb9-9816-898bb4ac7d64 req-8d3b1727-a3ff-49bd-8cec-fbb26fe763d7 service nova] Creating event network-vif-deleted:01735561-0af5-445a-b8c8-4842dba74030 for instance f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 on hv-cinder-84456 Oct 03 12:51:50.118681 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-d95c2a18-e1d0-4cb9-9816-898bb4ac7d64 req-8d3b1727-a3ff-49bd-8cec-fbb26fe763d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033477 Oct 03 12:51:50.119287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 146/290] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:51:50.428825 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a98b0ce7-10f6-4d39-bc16-be4e8036b178 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:50.429458 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a98b0ce7-10f6-4d39-bc16-be4e8036b178 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:50.437350 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a98b0ce7-10f6-4d39-bc16-be4e8036b178 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:50.437856 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a98b0ce7-10f6-4d39-bc16-be4e8036b178 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:50.438299 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a98b0ce7-10f6-4d39-bc16-be4e8036b178 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:50.439008 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a98b0ce7-10f6-4d39-bc16-be4e8036b178 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:50.439497 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a98b0ce7-10f6-4d39-bc16-be4e8036b178 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:50.440179 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a98b0ce7-10f6-4d39-bc16-be4e8036b178 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:50.548263 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-a98b0ce7-10f6-4d39-bc16-be4e8036b178 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:50.566025 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a98b0ce7-10f6-4d39-bc16-be4e8036b178 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1304 microversion: 2.1 time: 0.140115 Oct 03 12:51:50.589234 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 145/291] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:50 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1304 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:51.012954 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0077a45f-ec60-4a7a-890c-ca81843e96e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:51.012954 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-0077a45f-ec60-4a7a-890c-ca81843e96e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:51.021192 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0077a45f-ec60-4a7a-890c-ca81843e96e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:51.021995 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0077a45f-ec60-4a7a-890c-ca81843e96e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:51.022632 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0077a45f-ec60-4a7a-890c-ca81843e96e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:51.023604 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0077a45f-ec60-4a7a-890c-ca81843e96e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:51.024307 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0077a45f-ec60-4a7a-890c-ca81843e96e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:51.025007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0077a45f-ec60-4a7a-890c-ca81843e96e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:51.077176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d6f5402b-bff4-4c7c-9d68-8cca60d34805 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:51.082382 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d6f5402b-bff4-4c7c-9d68-8cca60d34805 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:51.100896 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d6f5402b-bff4-4c7c-9d68-8cca60d34805 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:51.105239 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d6f5402b-bff4-4c7c-9d68-8cca60d34805 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:51.105694 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d6f5402b-bff4-4c7c-9d68-8cca60d34805 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:51.108448 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d6f5402b-bff4-4c7c-9d68-8cca60d34805 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:51.120941 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d6f5402b-bff4-4c7c-9d68-8cca60d34805 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:51.121547 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d6f5402b-bff4-4c7c-9d68-8cca60d34805 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:51.202138 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d6f5402b-bff4-4c7c-9d68-8cca60d34805 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:51.203042 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d6f5402b-bff4-4c7c-9d68-8cca60d34805 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:51.203922 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d6f5402b-bff4-4c7c-9d68-8cca60d34805 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:51.204773 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-d6f5402b-bff4-4c7c-9d68-8cca60d34805 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lazy-loading 'fault' on Instance uuid f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:51:51.273900 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d6f5402b-bff4-4c7c-9d68-8cca60d34805 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:51.286299 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d6f5402b-bff4-4c7c-9d68-8cca60d34805 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1303 microversion: 2.1 time: 0.220722 Oct 03 12:51:51.300247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 146/292] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:51 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1303 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:51:51.374222 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0077a45f-ec60-4a7a-890c-ca81843e96e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:51.383041 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0077a45f-ec60-4a7a-890c-ca81843e96e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:51.388279 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0077a45f-ec60-4a7a-890c-ca81843e96e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:51.389122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-0077a45f-ec60-4a7a-890c-ca81843e96e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1724 microversion: 2.20 time: 0.381472 Oct 03 12:51:51.399630 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 147/293] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:51:51 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1724 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:51:51.598229 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-62319d10-5f46-4ad1-b9e6-51c326ebbcec tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:51.599954 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-62319d10-5f46-4ad1-b9e6-51c326ebbcec tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:51.626261 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-62319d10-5f46-4ad1-b9e6-51c326ebbcec tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:51.626942 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-62319d10-5f46-4ad1-b9e6-51c326ebbcec tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:51.628131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-62319d10-5f46-4ad1-b9e6-51c326ebbcec tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:51.629601 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-62319d10-5f46-4ad1-b9e6-51c326ebbcec tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:51.630013 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-62319d10-5f46-4ad1-b9e6-51c326ebbcec tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:51.635765 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-62319d10-5f46-4ad1-b9e6-51c326ebbcec tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:51.898003 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-62319d10-5f46-4ad1-b9e6-51c326ebbcec tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:51.906839 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-62319d10-5f46-4ad1-b9e6-51c326ebbcec tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.320758 Oct 03 12:51:51.907458 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 147/294] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:51 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:52.314220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c8d0b319-8db7-4c34-a1b7-f45be75a7b28 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:52.315601 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c8d0b319-8db7-4c34-a1b7-f45be75a7b28 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:52.337376 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c8d0b319-8db7-4c34-a1b7-f45be75a7b28 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:52.337376 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c8d0b319-8db7-4c34-a1b7-f45be75a7b28 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:52.337376 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c8d0b319-8db7-4c34-a1b7-f45be75a7b28 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:52.337376 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c8d0b319-8db7-4c34-a1b7-f45be75a7b28 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:52.337819 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c8d0b319-8db7-4c34-a1b7-f45be75a7b28 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:52.337819 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c8d0b319-8db7-4c34-a1b7-f45be75a7b28 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:52.387085 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c8d0b319-8db7-4c34-a1b7-f45be75a7b28 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:52.387915 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c8d0b319-8db7-4c34-a1b7-f45be75a7b28 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:52.388502 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c8d0b319-8db7-4c34-a1b7-f45be75a7b28 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:52.389100 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-c8d0b319-8db7-4c34-a1b7-f45be75a7b28 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lazy-loading 'fault' on Instance uuid f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:51:52.415375 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-5d4d7309-9209-48ba-b4d5-e213d6e9d46d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:52.416551 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-5d4d7309-9209-48ba-b4d5-e213d6e9d46d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:52.424728 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5d4d7309-9209-48ba-b4d5-e213d6e9d46d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:52.425697 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5d4d7309-9209-48ba-b4d5-e213d6e9d46d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:52.426315 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5d4d7309-9209-48ba-b4d5-e213d6e9d46d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:52.427364 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5d4d7309-9209-48ba-b4d5-e213d6e9d46d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:52.428644 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5d4d7309-9209-48ba-b4d5-e213d6e9d46d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:52.428891 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5d4d7309-9209-48ba-b4d5-e213d6e9d46d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:52.467497 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c8d0b319-8db7-4c34-a1b7-f45be75a7b28 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b322344df24e8ca513c19361b79257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb983cfa7dfe47b19a0a2d5ba652dabb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:52.476106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c8d0b319-8db7-4c34-a1b7-f45be75a7b28 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 200 len: 1303 microversion: 2.1 time: 0.167822 Oct 03 12:51:52.481431 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 148/295] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:52 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 1303 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:52.697432 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5d4d7309-9209-48ba-b4d5-e213d6e9d46d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:52.712154 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5d4d7309-9209-48ba-b4d5-e213d6e9d46d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:52.717048 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5d4d7309-9209-48ba-b4d5-e213d6e9d46d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:52.719373 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-5d4d7309-9209-48ba-b4d5-e213d6e9d46d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1724 microversion: 2.20 time: 0.309186 Oct 03 12:51:52.725277 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 148/296] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:51:52 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1724 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:51:52.747800 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d94aea3a-cda6-4033-b4fc-9ccb7f11207e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:51:52.756192 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d94aea3a-cda6-4033-b4fc-9ccb7f11207e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:52.756890 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d94aea3a-cda6-4033-b4fc-9ccb7f11207e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:52.757494 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d94aea3a-cda6-4033-b4fc-9ccb7f11207e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:52.853376 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d94aea3a-cda6-4033-b4fc-9ccb7f11207e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Going to try to stop instance {{(pid=127542) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 12:51:52.864457 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:52.931849 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-7714988a-c236-4d8e-b01a-4a3a0dc5bf8b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:52.932807 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-7714988a-c236-4d8e-b01a-4a3a0dc5bf8b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:52.942860 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7714988a-c236-4d8e-b01a-4a3a0dc5bf8b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:52.943500 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7714988a-c236-4d8e-b01a-4a3a0dc5bf8b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:52.944230 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7714988a-c236-4d8e-b01a-4a3a0dc5bf8b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:52.945049 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7714988a-c236-4d8e-b01a-4a3a0dc5bf8b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:52.945622 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7714988a-c236-4d8e-b01a-4a3a0dc5bf8b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:52.946116 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7714988a-c236-4d8e-b01a-4a3a0dc5bf8b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:53.100949 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d94aea3a-cda6-4033-b4fc-9ccb7f11207e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "POST /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/action" status: 202 len: 0 microversion: 2.1 time: 0.356995 Oct 03 12:51:53.101918 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 149/297] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 12:51:52 2022] POST /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:51:53.127865 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f0c60fbf-e301-4003-87c1-8361628e48b4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:53.142464 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f0c60fbf-e301-4003-87c1-8361628e48b4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:53.168490 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f0c60fbf-e301-4003-87c1-8361628e48b4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:53.168490 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f0c60fbf-e301-4003-87c1-8361628e48b4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:53.168490 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f0c60fbf-e301-4003-87c1-8361628e48b4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:53.168490 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f0c60fbf-e301-4003-87c1-8361628e48b4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:53.168945 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f0c60fbf-e301-4003-87c1-8361628e48b4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:53.168945 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f0c60fbf-e301-4003-87c1-8361628e48b4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:53.329999 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7714988a-c236-4d8e-b01a-4a3a0dc5bf8b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:53.339990 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-7714988a-c236-4d8e-b01a-4a3a0dc5bf8b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.412485 Oct 03 12:51:53.355835 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 149/298] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:52 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:53.376927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-841c80f8-6bfc-430d-a173-a4ceb5bc42c2 req-1f6551ac-5036-4763-8fdc-6c9915082c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d3f4ae-60a5-4463-9a02-00d846d22289", "tag": "99141c24-9fad-4cf8-9d13-c4d90e5ddd88"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:51:53.393584 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-841c80f8-6bfc-430d-a173-a4ceb5bc42c2 req-1f6551ac-5036-4763-8fdc-6c9915082c63 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:53.397541 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-841c80f8-6bfc-430d-a173-a4ceb5bc42c2 req-1f6551ac-5036-4763-8fdc-6c9915082c63 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:53.402166 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-841c80f8-6bfc-430d-a173-a4ceb5bc42c2 req-1f6551ac-5036-4763-8fdc-6c9915082c63 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:53.410076 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-841c80f8-6bfc-430d-a173-a4ceb5bc42c2 req-1f6551ac-5036-4763-8fdc-6c9915082c63 service nova] Creating event network-changed:99141c24-9fad-4cf8-9d13-c4d90e5ddd88 for instance 85d3f4ae-60a5-4463-9a02-00d846d22289 on hv-cinder-84456 Oct 03 12:51:53.415870 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-841c80f8-6bfc-430d-a173-a4ceb5bc42c2 req-1f6551ac-5036-4763-8fdc-6c9915082c63 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058656 Oct 03 12:51:53.416492 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 150/299] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:51:53.486589 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-f0c60fbf-e301-4003-87c1-8361628e48b4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:53.498940 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f0c60fbf-e301-4003-87c1-8361628e48b4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.380451 Oct 03 12:51:53.518840 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b16ee55a-cf24-4a1a-a59a-f062e1695b04 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:53.520205 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-b16ee55a-cf24-4a1a-a59a-f062e1695b04 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] [instance: f25ca40b-7241-41b9-8a8b-8e19a3bc14b2] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:53.520413 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 150/300] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:53 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:53.534078 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b16ee55a-cf24-4a1a-a59a-f062e1695b04 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:53.534078 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b16ee55a-cf24-4a1a-a59a-f062e1695b04 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:53.534078 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b16ee55a-cf24-4a1a-a59a-f062e1695b04 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:53.534078 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b16ee55a-cf24-4a1a-a59a-f062e1695b04 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:53.534485 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b16ee55a-cf24-4a1a-a59a-f062e1695b04 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:53.534485 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b16ee55a-cf24-4a1a-a59a-f062e1695b04 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:53.548085 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-b16ee55a-cf24-4a1a-a59a-f062e1695b04 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] HTTP exception thrown: Instance f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 could not be found. Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b16ee55a-cf24-4a1a-a59a-f062e1695b04 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Request method failure captured: Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 HTTP/1.1 Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtqsb2mPqKe69VW6LBgeyDPjBoYw2Xb3VX80UYu1RJEe72OlHsIGzJINu3VcZAOrQx3RM9HDajGwP1bdkMqatSdPQrQYtpi2gXGos-Fse356nywP5btdk9E6k6K5BB6nT6CDAXyrTVBnWrFsrwgRlbf1eG0VnMdKPJOTWJ9z6bXd9IY Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: eb983cfa7dfe47b19a0a2d5ba652dabb Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-VolumesActionsTest-212774216 Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 12:51:53.550107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 12:51:53.553156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb983cfa7dfe47b19a0a2d5ba652dabb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb983cfa7dfe47b19a0a2d5ba652dabb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb983cfa7dfe47b19a0a2d5ba652dabb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb983cfa7dfe47b19a0a2d5ba652dabb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:51:53.553156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-VolumesActionsTest-212774216 Oct 03 12:51:53.553156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: eb983cfa7dfe47b19a0a2d5ba652dabb Oct 03 12:51:53.553156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-VolumesActionsTest-212774216 Oct 03 12:51:53.553156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-VolumesActionsTest-212774216-project Oct 03 12:51:53.553156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 12:51:53.553156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 12:51:53.553156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: 78b322344df24e8ca513c19361b79257 Oct 03 12:51:53.553156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-VolumesActionsTest-212774216-project Oct 03 12:51:53.553156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 12:51:53.553156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Instance f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 could not be found. Oct 03 12:51:53.553156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': 'f25ca40b-7241-41b9-8a8b-8e19a3bc14b2'} Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 could not be found. Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:51:53.554026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 could not be found. Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 could not be found. Oct 03 12:51:53.555369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:51:53.558359 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b16ee55a-cf24-4a1a-a59a-f062e1695b04 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] Returning 404 to user: Instance f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:51:53.561076 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-b16ee55a-cf24-4a1a-a59a-f062e1695b04 tempest-VolumesActionsTest-212774216 tempest-VolumesActionsTest-212774216-project] 10.222.0.33 "GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2" status: 404 len: 111 microversion: 2.1 time: 0.047581 Oct 03 12:51:53.562121 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 151/301] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:53 2022] GET /compute/v2.1/servers/f25ca40b-7241-41b9-8a8b-8e19a3bc14b2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:51:53.752500 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-30f001ab-d848-4efb-b889-0db0a8672001 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:53.753448 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-30f001ab-d848-4efb-b889-0db0a8672001 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:53.763535 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-30f001ab-d848-4efb-b889-0db0a8672001 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:53.764402 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-30f001ab-d848-4efb-b889-0db0a8672001 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:53.764949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-30f001ab-d848-4efb-b889-0db0a8672001 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:53.765676 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-30f001ab-d848-4efb-b889-0db0a8672001 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:53.766677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-30f001ab-d848-4efb-b889-0db0a8672001 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:53.768277 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-30f001ab-d848-4efb-b889-0db0a8672001 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:53.956367 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-30f001ab-d848-4efb-b889-0db0a8672001 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:53.967203 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-30f001ab-d848-4efb-b889-0db0a8672001 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:53.968955 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-30f001ab-d848-4efb-b889-0db0a8672001 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:53.970244 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-30f001ab-d848-4efb-b889-0db0a8672001 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1724 microversion: 2.20 time: 0.223510 Oct 03 12:51:53.987414 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 152/302] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:51:53 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:51:53.991004 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-2dc56ead-3df2-4116-852b-9184808e8062 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Action: 'create', calling method: .version_select at 0x7fc7403b8e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-745508035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvhui2S+DkvydzdnPEPKRZKOXOe14nYvMpC7fnuhAkBM7XlxPXfXUW7xH6f3suhHvMNulQXujrFS69/b1z7FsJZsWzDjKGwiU4NMJtcPdc//4U7MvjofBv0JVQI/8nEMg=="}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:51:54.027640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-2dc56ead-3df2-4116-852b-9184808e8062 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Getting quotas for project 38d1778202d041b58934150c6af9685c. Resources: {'key_pairs'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:51:54.029116 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-2dc56ead-3df2-4116-852b-9184808e8062 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Getting quotas for user 7ffffa27986f461ebc10c23c3c9817f0 and project 38d1778202d041b58934150c6af9685c. Resources: {'key_pairs'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:51:54.158680 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-2dc56ead-3df2-4116-852b-9184808e8062 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.436381 Oct 03 12:51:54.158680 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 151/303] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 12:51:53 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:51:54.369482 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e00307eb-c1e4-4fe3-9a61-e1c54d47a805 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:54.370038 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-e00307eb-c1e4-4fe3-9a61-e1c54d47a805 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:54.387961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e00307eb-c1e4-4fe3-9a61-e1c54d47a805 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:54.388639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e00307eb-c1e4-4fe3-9a61-e1c54d47a805 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:54.389236 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e00307eb-c1e4-4fe3-9a61-e1c54d47a805 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:54.392978 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e00307eb-c1e4-4fe3-9a61-e1c54d47a805 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:54.392978 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e00307eb-c1e4-4fe3-9a61-e1c54d47a805 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:54.392978 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e00307eb-c1e4-4fe3-9a61-e1c54d47a805 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:54.528492 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1e4dad2d-8859-4e16-b687-580c85396daf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:54.530128 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-1e4dad2d-8859-4e16-b687-580c85396daf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:54.541616 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1e4dad2d-8859-4e16-b687-580c85396daf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:54.542319 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1e4dad2d-8859-4e16-b687-580c85396daf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:54.542923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1e4dad2d-8859-4e16-b687-580c85396daf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:54.543875 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1e4dad2d-8859-4e16-b687-580c85396daf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:54.545180 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1e4dad2d-8859-4e16-b687-580c85396daf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:54.547146 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1e4dad2d-8859-4e16-b687-580c85396daf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:54.571946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e00307eb-c1e4-4fe3-9a61-e1c54d47a805 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:54.583472 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e00307eb-c1e4-4fe3-9a61-e1c54d47a805 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.220284 Oct 03 12:51:54.595441 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 153/304] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:54 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:54.714663 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-1e4dad2d-8859-4e16-b687-580c85396daf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:54.724223 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-1e4dad2d-8859-4e16-b687-580c85396daf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.201659 Oct 03 12:51:54.724808 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 152/305] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:54 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:51:55.014474 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bfe59d10-3a30-46a5-b5f9-fd8a045bbaf4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:55.014615 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-bfe59d10-3a30-46a5-b5f9-fd8a045bbaf4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:55.044550 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bfe59d10-3a30-46a5-b5f9-fd8a045bbaf4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:55.045495 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bfe59d10-3a30-46a5-b5f9-fd8a045bbaf4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:55.046161 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bfe59d10-3a30-46a5-b5f9-fd8a045bbaf4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:55.048486 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bfe59d10-3a30-46a5-b5f9-fd8a045bbaf4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:55.050448 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bfe59d10-3a30-46a5-b5f9-fd8a045bbaf4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:55.052244 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bfe59d10-3a30-46a5-b5f9-fd8a045bbaf4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:55.259760 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-bfe59d10-3a30-46a5-b5f9-fd8a045bbaf4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:55.271675 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-bfe59d10-3a30-46a5-b5f9-fd8a045bbaf4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:55.273768 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-bfe59d10-3a30-46a5-b5f9-fd8a045bbaf4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:55.276972 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-bfe59d10-3a30-46a5-b5f9-fd8a045bbaf4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1724 microversion: 2.20 time: 0.282504 Oct 03 12:51:55.277554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 154/306] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:51:54 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:51:55.607715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-26568fd4-dd3b-4b08-bb66-3c571969adef tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:55.609087 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-26568fd4-dd3b-4b08-bb66-3c571969adef tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:55.613484 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:55.621162 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-26568fd4-dd3b-4b08-bb66-3c571969adef tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:55.621844 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-26568fd4-dd3b-4b08-bb66-3c571969adef tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:55.622506 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-26568fd4-dd3b-4b08-bb66-3c571969adef tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:55.623299 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-26568fd4-dd3b-4b08-bb66-3c571969adef tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:55.623889 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-26568fd4-dd3b-4b08-bb66-3c571969adef tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:55.624392 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-26568fd4-dd3b-4b08-bb66-3c571969adef tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:55.752130 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-7b0acb52-fe3c-4cf4-9cd0-7c3728fd0d39 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:55.752743 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-7b0acb52-fe3c-4cf4-9cd0-7c3728fd0d39 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:55.759910 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7b0acb52-fe3c-4cf4-9cd0-7c3728fd0d39 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:55.760882 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7b0acb52-fe3c-4cf4-9cd0-7c3728fd0d39 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:55.762334 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7b0acb52-fe3c-4cf4-9cd0-7c3728fd0d39 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:55.763147 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7b0acb52-fe3c-4cf4-9cd0-7c3728fd0d39 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:55.763693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7b0acb52-fe3c-4cf4-9cd0-7c3728fd0d39 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:55.764133 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7b0acb52-fe3c-4cf4-9cd0-7c3728fd0d39 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:55.782497 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-26568fd4-dd3b-4b08-bb66-3c571969adef tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:55.799934 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-26568fd4-dd3b-4b08-bb66-3c571969adef tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.196990 Oct 03 12:51:55.812389 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 153/307] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:55 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:55.919029 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=6 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:55.973546 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7b0acb52-fe3c-4cf4-9cd0-7c3728fd0d39 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:55.982614 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-7b0acb52-fe3c-4cf4-9cd0-7c3728fd0d39 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.234511 Oct 03 12:51:55.984605 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 155/308] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:55 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:56.303023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-74749de8-5f17-430f-9e0a-dd872e4704fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:56.303668 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-74749de8-5f17-430f-9e0a-dd872e4704fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:56.309725 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-74749de8-5f17-430f-9e0a-dd872e4704fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:56.310250 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-74749de8-5f17-430f-9e0a-dd872e4704fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:56.310751 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-74749de8-5f17-430f-9e0a-dd872e4704fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:56.311675 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-74749de8-5f17-430f-9e0a-dd872e4704fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:56.312136 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-74749de8-5f17-430f-9e0a-dd872e4704fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:56.313025 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-74749de8-5f17-430f-9e0a-dd872e4704fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:56.477569 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-74749de8-5f17-430f-9e0a-dd872e4704fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:56.517322 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-74749de8-5f17-430f-9e0a-dd872e4704fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:56.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-74749de8-5f17-430f-9e0a-dd872e4704fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:56.526328 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-74749de8-5f17-430f-9e0a-dd872e4704fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1724 microversion: 2.20 time: 0.222166 Oct 03 12:51:56.526328 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 154/309] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:51:56 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:51:56.835919 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-7c234830-0cc0-437b-a4c4-fb5d1a18202d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:56.839490 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-7c234830-0cc0-437b-a4c4-fb5d1a18202d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:56.855478 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7c234830-0cc0-437b-a4c4-fb5d1a18202d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:56.857646 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7c234830-0cc0-437b-a4c4-fb5d1a18202d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:56.860167 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7c234830-0cc0-437b-a4c4-fb5d1a18202d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:56.861091 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7c234830-0cc0-437b-a4c4-fb5d1a18202d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:56.862800 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7c234830-0cc0-437b-a4c4-fb5d1a18202d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:56.863487 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7c234830-0cc0-437b-a4c4-fb5d1a18202d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:57.019979 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d86774e3-6adb-4105-aeca-8859221cfd50 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:57.021314 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d86774e3-6adb-4105-aeca-8859221cfd50 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:57.031495 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d86774e3-6adb-4105-aeca-8859221cfd50 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:57.034414 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d86774e3-6adb-4105-aeca-8859221cfd50 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:57.034414 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d86774e3-6adb-4105-aeca-8859221cfd50 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:57.034414 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d86774e3-6adb-4105-aeca-8859221cfd50 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:57.034414 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d86774e3-6adb-4105-aeca-8859221cfd50 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:57.034725 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d86774e3-6adb-4105-aeca-8859221cfd50 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:57.083146 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7c234830-0cc0-437b-a4c4-fb5d1a18202d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:57.098700 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-7c234830-0cc0-437b-a4c4-fb5d1a18202d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.267198 Oct 03 12:51:57.100621 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 156/310] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:56 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:57.291632 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d86774e3-6adb-4105-aeca-8859221cfd50 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:57.305624 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d86774e3-6adb-4105-aeca-8859221cfd50 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.293305 Oct 03 12:51:57.306309 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 155/311] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:57 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:57.565030 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-fcfb82b7-80ff-433c-ab8d-a90bb1599e71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:57.566283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-fcfb82b7-80ff-433c-ab8d-a90bb1599e71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:57.573969 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fcfb82b7-80ff-433c-ab8d-a90bb1599e71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:57.574778 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fcfb82b7-80ff-433c-ab8d-a90bb1599e71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:57.575290 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fcfb82b7-80ff-433c-ab8d-a90bb1599e71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:57.576291 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fcfb82b7-80ff-433c-ab8d-a90bb1599e71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:57.576972 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fcfb82b7-80ff-433c-ab8d-a90bb1599e71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:57.577464 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fcfb82b7-80ff-433c-ab8d-a90bb1599e71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:57.889666 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-fcfb82b7-80ff-433c-ab8d-a90bb1599e71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:57.898613 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-fcfb82b7-80ff-433c-ab8d-a90bb1599e71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:57.902258 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-fcfb82b7-80ff-433c-ab8d-a90bb1599e71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:57.902419 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-fcfb82b7-80ff-433c-ab8d-a90bb1599e71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1724 microversion: 2.20 time: 0.341513 Oct 03 12:51:57.903108 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 157/312] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:51:57 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1724 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:51:58.131658 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-32c7ebf5-1245-47f8-b41c-43e94230b628 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:58.132280 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-32c7ebf5-1245-47f8-b41c-43e94230b628 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:58.139729 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-32c7ebf5-1245-47f8-b41c-43e94230b628 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:58.140714 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-32c7ebf5-1245-47f8-b41c-43e94230b628 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:58.141171 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-32c7ebf5-1245-47f8-b41c-43e94230b628 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:58.141880 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-32c7ebf5-1245-47f8-b41c-43e94230b628 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:58.142339 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-32c7ebf5-1245-47f8-b41c-43e94230b628 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:58.142785 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-32c7ebf5-1245-47f8-b41c-43e94230b628 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:58.294766 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-32c7ebf5-1245-47f8-b41c-43e94230b628 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:58.303298 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-32c7ebf5-1245-47f8-b41c-43e94230b628 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.181295 Oct 03 12:51:58.303882 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 156/313] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:58 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:58.328859 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3d6940dc-4663-4aa4-8f6a-0ae2173b5109 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:58.329518 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-3d6940dc-4663-4aa4-8f6a-0ae2173b5109 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:58.336387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3d6940dc-4663-4aa4-8f6a-0ae2173b5109 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:58.336941 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3d6940dc-4663-4aa4-8f6a-0ae2173b5109 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:58.337368 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3d6940dc-4663-4aa4-8f6a-0ae2173b5109 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:58.338359 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3d6940dc-4663-4aa4-8f6a-0ae2173b5109 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:58.338828 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3d6940dc-4663-4aa4-8f6a-0ae2173b5109 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:58.339261 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3d6940dc-4663-4aa4-8f6a-0ae2173b5109 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:58.508652 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3d6940dc-4663-4aa4-8f6a-0ae2173b5109 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:58.522703 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-3d6940dc-4663-4aa4-8f6a-0ae2173b5109 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.196424 Oct 03 12:51:58.527510 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 158/314] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:58 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:58.929588 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a6eee931-17d4-4a61-a033-5fe0bccac299 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:58.930191 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a6eee931-17d4-4a61-a033-5fe0bccac299 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:58.937140 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a6eee931-17d4-4a61-a033-5fe0bccac299 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:58.937632 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a6eee931-17d4-4a61-a033-5fe0bccac299 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:58.938062 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a6eee931-17d4-4a61-a033-5fe0bccac299 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:58.938764 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a6eee931-17d4-4a61-a033-5fe0bccac299 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:58.939198 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a6eee931-17d4-4a61-a033-5fe0bccac299 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:58.939649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a6eee931-17d4-4a61-a033-5fe0bccac299 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:59.072249 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a6eee931-17d4-4a61-a033-5fe0bccac299 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:59.080511 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a6eee931-17d4-4a61-a033-5fe0bccac299 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:59.082046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a6eee931-17d4-4a61-a033-5fe0bccac299 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:59.084105 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a6eee931-17d4-4a61-a033-5fe0bccac299 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1724 microversion: 2.20 time: 0.158407 Oct 03 12:51:59.084741 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 157/315] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:51:58 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:51:59.326004 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-841c5e64-4c75-47c8-9cc0-47554a12944b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:59.326557 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-841c5e64-4c75-47c8-9cc0-47554a12944b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:59.333070 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-841c5e64-4c75-47c8-9cc0-47554a12944b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:59.333570 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-841c5e64-4c75-47c8-9cc0-47554a12944b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:59.334009 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-841c5e64-4c75-47c8-9cc0-47554a12944b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:59.334711 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-841c5e64-4c75-47c8-9cc0-47554a12944b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:59.335168 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-841c5e64-4c75-47c8-9cc0-47554a12944b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:59.335648 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-841c5e64-4c75-47c8-9cc0-47554a12944b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:59.467986 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-841c5e64-4c75-47c8-9cc0-47554a12944b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:59.475755 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-841c5e64-4c75-47c8-9cc0-47554a12944b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.153611 Oct 03 12:51:59.476372 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 159/316] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:59 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:51:59.547130 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-25b4b023-45ad-4bf3-9572-456d9b01273d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:51:59.547777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-25b4b023-45ad-4bf3-9572-456d9b01273d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:51:59.558989 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-25b4b023-45ad-4bf3-9572-456d9b01273d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:59.559521 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-25b4b023-45ad-4bf3-9572-456d9b01273d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:59.559965 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-25b4b023-45ad-4bf3-9572-456d9b01273d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:59.560676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-25b4b023-45ad-4bf3-9572-456d9b01273d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:51:59.561133 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-25b4b023-45ad-4bf3-9572-456d9b01273d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:51:59.561561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-25b4b023-45ad-4bf3-9572-456d9b01273d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:51:59.692838 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-25b4b023-45ad-4bf3-9572-456d9b01273d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:51:59.701191 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-25b4b023-45ad-4bf3-9572-456d9b01273d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.157730 Oct 03 12:51:59.701763 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 158/317] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:51:59 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:00.109332 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-5048c8fe-34cb-4bbb-972c-548f541964ea tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:00.109944 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-5048c8fe-34cb-4bbb-972c-548f541964ea tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:00.116196 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5048c8fe-34cb-4bbb-972c-548f541964ea tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:00.122210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5048c8fe-34cb-4bbb-972c-548f541964ea tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:00.122210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5048c8fe-34cb-4bbb-972c-548f541964ea tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:00.122210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5048c8fe-34cb-4bbb-972c-548f541964ea tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:00.122210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5048c8fe-34cb-4bbb-972c-548f541964ea tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:00.122551 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5048c8fe-34cb-4bbb-972c-548f541964ea tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:00.133391 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:00.482401 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5048c8fe-34cb-4bbb-972c-548f541964ea tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:00.490430 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5048c8fe-34cb-4bbb-972c-548f541964ea tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:00.492180 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5048c8fe-34cb-4bbb-972c-548f541964ea tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:00.493364 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-5048c8fe-34cb-4bbb-972c-548f541964ea tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1724 microversion: 2.20 time: 0.388015 Oct 03 12:52:00.493917 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 160/318] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:00 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1724 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:00.498020 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a1757eb8-416b-4c4c-8b4e-9d108daf661e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:00.498672 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a1757eb8-416b-4c4c-8b4e-9d108daf661e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:00.505620 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a1757eb8-416b-4c4c-8b4e-9d108daf661e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:00.506120 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a1757eb8-416b-4c4c-8b4e-9d108daf661e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:00.506565 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a1757eb8-416b-4c4c-8b4e-9d108daf661e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:00.507269 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a1757eb8-416b-4c4c-8b4e-9d108daf661e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:00.507755 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a1757eb8-416b-4c4c-8b4e-9d108daf661e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:00.508190 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a1757eb8-416b-4c4c-8b4e-9d108daf661e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:00.643217 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a1757eb8-416b-4c4c-8b4e-9d108daf661e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:00.648343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a1757eb8-416b-4c4c-8b4e-9d108daf661e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.154175 Oct 03 12:52:00.648900 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 159/319] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:00 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:52:00.724498 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-1dc8860b-94b7-4f27-85f3-f62d1d9ba73d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:00.725112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-1dc8860b-94b7-4f27-85f3-f62d1d9ba73d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:00.731064 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1dc8860b-94b7-4f27-85f3-f62d1d9ba73d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:00.731583 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1dc8860b-94b7-4f27-85f3-f62d1d9ba73d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:00.732021 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1dc8860b-94b7-4f27-85f3-f62d1d9ba73d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:00.732716 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1dc8860b-94b7-4f27-85f3-f62d1d9ba73d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:00.733170 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1dc8860b-94b7-4f27-85f3-f62d1d9ba73d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:00.733594 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1dc8860b-94b7-4f27-85f3-f62d1d9ba73d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:00.861499 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-1dc8860b-94b7-4f27-85f3-f62d1d9ba73d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:00.870103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-1dc8860b-94b7-4f27-85f3-f62d1d9ba73d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.149440 Oct 03 12:52:00.870665 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 161/320] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:00 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:01.518249 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3c21faa0-b171-4334-be82-d1819481c590 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:01.518877 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3c21faa0-b171-4334-be82-d1819481c590 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:01.524966 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c21faa0-b171-4334-be82-d1819481c590 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:01.525464 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c21faa0-b171-4334-be82-d1819481c590 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:01.525903 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c21faa0-b171-4334-be82-d1819481c590 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:01.526603 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c21faa0-b171-4334-be82-d1819481c590 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:01.527063 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c21faa0-b171-4334-be82-d1819481c590 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:01.527517 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c21faa0-b171-4334-be82-d1819481c590 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:01.664304 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3c21faa0-b171-4334-be82-d1819481c590 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:01.672488 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-20719c5b-f13a-4f12-8fef-4a6fa3da6eeb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:01.673408 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-20719c5b-f13a-4f12-8fef-4a6fa3da6eeb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:01.674199 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3c21faa0-b171-4334-be82-d1819481c590 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:01.675671 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3c21faa0-b171-4334-be82-d1819481c590 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:01.681796 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20719c5b-f13a-4f12-8fef-4a6fa3da6eeb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:01.682527 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20719c5b-f13a-4f12-8fef-4a6fa3da6eeb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:01.684016 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20719c5b-f13a-4f12-8fef-4a6fa3da6eeb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:01.684291 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3c21faa0-b171-4334-be82-d1819481c590 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1724 microversion: 2.20 time: 0.163354 Oct 03 12:52:01.685185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 160/321] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:01 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:01.685475 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20719c5b-f13a-4f12-8fef-4a6fa3da6eeb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:01.686161 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20719c5b-f13a-4f12-8fef-4a6fa3da6eeb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:01.686697 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20719c5b-f13a-4f12-8fef-4a6fa3da6eeb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:01.834974 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-20719c5b-f13a-4f12-8fef-4a6fa3da6eeb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:01.844167 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-20719c5b-f13a-4f12-8fef-4a6fa3da6eeb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.176544 Oct 03 12:52:01.845187 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 162/322] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:01 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:52:01.893327 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-661742ea-bf92-4808-8d78-bc7bff311b62 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:01.893970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-661742ea-bf92-4808-8d78-bc7bff311b62 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:01.909727 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661742ea-bf92-4808-8d78-bc7bff311b62 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:01.910293 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661742ea-bf92-4808-8d78-bc7bff311b62 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:01.914014 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661742ea-bf92-4808-8d78-bc7bff311b62 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:01.914014 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661742ea-bf92-4808-8d78-bc7bff311b62 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:01.914014 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661742ea-bf92-4808-8d78-bc7bff311b62 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:01.914014 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661742ea-bf92-4808-8d78-bc7bff311b62 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:02.047535 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-661742ea-bf92-4808-8d78-bc7bff311b62 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:02.055887 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-661742ea-bf92-4808-8d78-bc7bff311b62 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.166549 Oct 03 12:52:02.056445 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 161/323] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:01 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:02.709957 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8ed0abfd-a565-46e9-bba7-ecd5d6a17588 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:02.710619 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8ed0abfd-a565-46e9-bba7-ecd5d6a17588 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:02.717892 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8ed0abfd-a565-46e9-bba7-ecd5d6a17588 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:02.718914 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8ed0abfd-a565-46e9-bba7-ecd5d6a17588 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:02.719221 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8ed0abfd-a565-46e9-bba7-ecd5d6a17588 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:02.719985 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8ed0abfd-a565-46e9-bba7-ecd5d6a17588 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:02.720448 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8ed0abfd-a565-46e9-bba7-ecd5d6a17588 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:02.720934 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8ed0abfd-a565-46e9-bba7-ecd5d6a17588 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:02.869775 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f329f912-b5f7-43d5-8e61-0f0186e7b719 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:02.871684 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f329f912-b5f7-43d5-8e61-0f0186e7b719 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:02.878567 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f329f912-b5f7-43d5-8e61-0f0186e7b719 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:02.883204 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f329f912-b5f7-43d5-8e61-0f0186e7b719 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:02.883204 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f329f912-b5f7-43d5-8e61-0f0186e7b719 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:02.883204 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f329f912-b5f7-43d5-8e61-0f0186e7b719 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:02.883204 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f329f912-b5f7-43d5-8e61-0f0186e7b719 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:02.883563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f329f912-b5f7-43d5-8e61-0f0186e7b719 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:02.893575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8ed0abfd-a565-46e9-bba7-ecd5d6a17588 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:02.902247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8ed0abfd-a565-46e9-bba7-ecd5d6a17588 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:02.903717 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8ed0abfd-a565-46e9-bba7-ecd5d6a17588 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:02.917994 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-8ed0abfd-a565-46e9-bba7-ecd5d6a17588 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1724 microversion: 2.20 time: 0.198775 Oct 03 12:52:02.919127 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 163/324] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:02 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:03.051809 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-f329f912-b5f7-43d5-8e61-0f0186e7b719 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:03.060644 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f329f912-b5f7-43d5-8e61-0f0186e7b719 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.196852 Oct 03 12:52:03.084230 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-df54b199-a1ef-4feb-912b-b9ea21a3fe9b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:03.084885 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-df54b199-a1ef-4feb-912b-b9ea21a3fe9b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:03.088605 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 162/325] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:02 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:03.092718 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-df54b199-a1ef-4feb-912b-b9ea21a3fe9b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:03.093248 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-df54b199-a1ef-4feb-912b-b9ea21a3fe9b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:03.093710 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-df54b199-a1ef-4feb-912b-b9ea21a3fe9b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:03.094414 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-df54b199-a1ef-4feb-912b-b9ea21a3fe9b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:03.094870 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-df54b199-a1ef-4feb-912b-b9ea21a3fe9b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:03.095302 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-df54b199-a1ef-4feb-912b-b9ea21a3fe9b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:03.251915 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-df54b199-a1ef-4feb-912b-b9ea21a3fe9b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:03.268068 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-df54b199-a1ef-4feb-912b-b9ea21a3fe9b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.188639 Oct 03 12:52:03.268750 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 164/326] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:03 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:52:03.945185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-5212b83c-de38-4173-b817-911922b09f52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:03.945827 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-5212b83c-de38-4173-b817-911922b09f52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:03.953077 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5212b83c-de38-4173-b817-911922b09f52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:03.953569 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5212b83c-de38-4173-b817-911922b09f52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:03.954058 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5212b83c-de38-4173-b817-911922b09f52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:03.954755 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5212b83c-de38-4173-b817-911922b09f52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:03.955212 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5212b83c-de38-4173-b817-911922b09f52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:03.955673 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5212b83c-de38-4173-b817-911922b09f52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:04.038261 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=12 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:04.086316 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-f84b6bb6-8e74-4e96-bc4c-559369763d98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:04.086994 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-f84b6bb6-8e74-4e96-bc4c-559369763d98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:04.093016 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f84b6bb6-8e74-4e96-bc4c-559369763d98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:04.093496 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f84b6bb6-8e74-4e96-bc4c-559369763d98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:04.093936 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f84b6bb6-8e74-4e96-bc4c-559369763d98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:04.094623 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f84b6bb6-8e74-4e96-bc4c-559369763d98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:04.095109 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f84b6bb6-8e74-4e96-bc4c-559369763d98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:04.095560 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f84b6bb6-8e74-4e96-bc4c-559369763d98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:04.101930 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-5212b83c-de38-4173-b817-911922b09f52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:04.110634 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-5212b83c-de38-4173-b817-911922b09f52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:04.112417 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-5212b83c-de38-4173-b817-911922b09f52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:04.113756 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-5212b83c-de38-4173-b817-911922b09f52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1724 microversion: 2.20 time: 0.173625 Oct 03 12:52:04.114475 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 163/327] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:03 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:04.263848 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-f84b6bb6-8e74-4e96-bc4c-559369763d98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:04.266863 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-f84b6bb6-8e74-4e96-bc4c-559369763d98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.185047 Oct 03 12:52:04.267459 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 165/328] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:04 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:52:04.512931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-6b44c53c-21b6-4813-a29d-b8c77b5cd495 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:04.512931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-6b44c53c-21b6-4813-a29d-b8c77b5cd495 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:04.512931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b44c53c-21b6-4813-a29d-b8c77b5cd495 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:04.512931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b44c53c-21b6-4813-a29d-b8c77b5cd495 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:04.513715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b44c53c-21b6-4813-a29d-b8c77b5cd495 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:04.513715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b44c53c-21b6-4813-a29d-b8c77b5cd495 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:04.513715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b44c53c-21b6-4813-a29d-b8c77b5cd495 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:04.513715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b44c53c-21b6-4813-a29d-b8c77b5cd495 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:04.513979 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6b44c53c-21b6-4813-a29d-b8c77b5cd495 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:04.513979 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-6b44c53c-21b6-4813-a29d-b8c77b5cd495 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.187396 Oct 03 12:52:04.513979 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 164/329] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:04 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:05.151703 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d86d3e25-c356-4a3f-91e4-82bce45d77c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:05.152679 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d86d3e25-c356-4a3f-91e4-82bce45d77c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:05.159747 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d86d3e25-c356-4a3f-91e4-82bce45d77c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:05.160523 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d86d3e25-c356-4a3f-91e4-82bce45d77c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:05.161219 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d86d3e25-c356-4a3f-91e4-82bce45d77c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:05.162178 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d86d3e25-c356-4a3f-91e4-82bce45d77c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:05.163105 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d86d3e25-c356-4a3f-91e4-82bce45d77c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:05.163645 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d86d3e25-c356-4a3f-91e4-82bce45d77c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:05.293994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ae7d90ef-b4d1-4182-bb96-8084be4ff182 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:05.295289 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-ae7d90ef-b4d1-4182-bb96-8084be4ff182 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:05.305595 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae7d90ef-b4d1-4182-bb96-8084be4ff182 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:05.306574 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae7d90ef-b4d1-4182-bb96-8084be4ff182 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:05.307338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae7d90ef-b4d1-4182-bb96-8084be4ff182 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:05.308317 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae7d90ef-b4d1-4182-bb96-8084be4ff182 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:05.309015 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae7d90ef-b4d1-4182-bb96-8084be4ff182 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:05.309714 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae7d90ef-b4d1-4182-bb96-8084be4ff182 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:05.353347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d86d3e25-c356-4a3f-91e4-82bce45d77c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:05.362154 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d86d3e25-c356-4a3f-91e4-82bce45d77c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:05.364426 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d86d3e25-c356-4a3f-91e4-82bce45d77c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:05.365724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d86d3e25-c356-4a3f-91e4-82bce45d77c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1724 microversion: 2.20 time: 0.218471 Oct 03 12:52:05.367070 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 166/330] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:05 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:05.466398 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-ae7d90ef-b4d1-4182-bb96-8084be4ff182 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:05.474979 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-ae7d90ef-b4d1-4182-bb96-8084be4ff182 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.187684 Oct 03 12:52:05.476826 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 165/331] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:05 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:05.533042 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-50c14692-67c5-4ee1-a25e-73de8aaba3e5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:05.534163 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-50c14692-67c5-4ee1-a25e-73de8aaba3e5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:05.544000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50c14692-67c5-4ee1-a25e-73de8aaba3e5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:05.545206 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50c14692-67c5-4ee1-a25e-73de8aaba3e5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:05.545838 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50c14692-67c5-4ee1-a25e-73de8aaba3e5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:05.546865 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50c14692-67c5-4ee1-a25e-73de8aaba3e5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:05.547659 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50c14692-67c5-4ee1-a25e-73de8aaba3e5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:05.548312 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50c14692-67c5-4ee1-a25e-73de8aaba3e5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:05.733875 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-50c14692-67c5-4ee1-a25e-73de8aaba3e5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:05.744259 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-50c14692-67c5-4ee1-a25e-73de8aaba3e5 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.218514 Oct 03 12:52:05.745585 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 167/332] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:05 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:06.394086 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e4ec6cd4-01f7-470a-b18c-f80b81d61f17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:06.395605 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e4ec6cd4-01f7-470a-b18c-f80b81d61f17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:06.402876 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e4ec6cd4-01f7-470a-b18c-f80b81d61f17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:06.403784 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e4ec6cd4-01f7-470a-b18c-f80b81d61f17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:06.404458 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e4ec6cd4-01f7-470a-b18c-f80b81d61f17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:06.405583 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e4ec6cd4-01f7-470a-b18c-f80b81d61f17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:06.406233 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e4ec6cd4-01f7-470a-b18c-f80b81d61f17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:06.406682 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e4ec6cd4-01f7-470a-b18c-f80b81d61f17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:06.427144 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:06.516137 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-633fac3d-f4e7-4a66-9761-9f158144f370 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:06.517066 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-633fac3d-f4e7-4a66-9761-9f158144f370 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:06.533554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-633fac3d-f4e7-4a66-9761-9f158144f370 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:06.534065 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-633fac3d-f4e7-4a66-9761-9f158144f370 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:06.534541 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-633fac3d-f4e7-4a66-9761-9f158144f370 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:06.536347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-633fac3d-f4e7-4a66-9761-9f158144f370 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:06.536829 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-633fac3d-f4e7-4a66-9761-9f158144f370 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:06.537718 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-633fac3d-f4e7-4a66-9761-9f158144f370 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:06.586764 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e4ec6cd4-01f7-470a-b18c-f80b81d61f17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:06.595598 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e4ec6cd4-01f7-470a-b18c-f80b81d61f17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:06.598118 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e4ec6cd4-01f7-470a-b18c-f80b81d61f17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:06.614426 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e4ec6cd4-01f7-470a-b18c-f80b81d61f17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1724 microversion: 2.20 time: 0.209784 Oct 03 12:52:06.622449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 166/333] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:06 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:06.745187 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-633fac3d-f4e7-4a66-9761-9f158144f370 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:06.752744 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-633fac3d-f4e7-4a66-9761-9f158144f370 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.258116 Oct 03 12:52:06.753248 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 168/334] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:06 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:06.774671 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-11c35a61-0133-46e3-a4f2-c16cb666173a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:06.775307 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-11c35a61-0133-46e3-a4f2-c16cb666173a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:06.782684 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-11c35a61-0133-46e3-a4f2-c16cb666173a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:06.783341 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-11c35a61-0133-46e3-a4f2-c16cb666173a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:06.783790 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-11c35a61-0133-46e3-a4f2-c16cb666173a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:06.784561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-11c35a61-0133-46e3-a4f2-c16cb666173a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:06.785022 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-11c35a61-0133-46e3-a4f2-c16cb666173a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:06.786035 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-11c35a61-0133-46e3-a4f2-c16cb666173a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:06.929503 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-11c35a61-0133-46e3-a4f2-c16cb666173a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:06.938020 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-11c35a61-0133-46e3-a4f2-c16cb666173a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.169436 Oct 03 12:52:06.938988 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 167/335] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:06 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:07.642350 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-02970d6b-08a9-40e5-a09a-befca553b709 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:07.643174 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-02970d6b-08a9-40e5-a09a-befca553b709 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:07.649562 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02970d6b-08a9-40e5-a09a-befca553b709 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:07.650330 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02970d6b-08a9-40e5-a09a-befca553b709 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:07.650783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02970d6b-08a9-40e5-a09a-befca553b709 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:07.651548 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02970d6b-08a9-40e5-a09a-befca553b709 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:07.652163 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02970d6b-08a9-40e5-a09a-befca553b709 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:07.652805 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02970d6b-08a9-40e5-a09a-befca553b709 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:07.778816 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ec6c01ee-e478-49b9-9dc7-0a03ac035e8f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:07.779678 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-ec6c01ee-e478-49b9-9dc7-0a03ac035e8f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:07.794274 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ec6c01ee-e478-49b9-9dc7-0a03ac035e8f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:07.795018 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ec6c01ee-e478-49b9-9dc7-0a03ac035e8f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:07.799925 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ec6c01ee-e478-49b9-9dc7-0a03ac035e8f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:07.799925 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ec6c01ee-e478-49b9-9dc7-0a03ac035e8f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:07.800770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ec6c01ee-e478-49b9-9dc7-0a03ac035e8f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:07.802180 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ec6c01ee-e478-49b9-9dc7-0a03ac035e8f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:07.930597 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-02970d6b-08a9-40e5-a09a-befca553b709 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:07.943875 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-02970d6b-08a9-40e5-a09a-befca553b709 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:07.946007 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-02970d6b-08a9-40e5-a09a-befca553b709 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:07.947425 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-02970d6b-08a9-40e5-a09a-befca553b709 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1745 microversion: 2.20 time: 0.308951 Oct 03 12:52:07.970455 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 169/336] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:07 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1745 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:07.990867 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-450450c8-6a17-4b5d-8cd9-053382ebde26 req-e3a6bbb7-940a-447d-875a-d85482120035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d3f4ae-60a5-4463-9a02-00d846d22289", "name": "network-vif-plugged", "status": "completed", "tag": "99141c24-9fad-4cf8-9d13-c4d90e5ddd88"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:52:08.014593 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-450450c8-6a17-4b5d-8cd9-053382ebde26 req-e3a6bbb7-940a-447d-875a-d85482120035 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:08.015885 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-450450c8-6a17-4b5d-8cd9-053382ebde26 req-e3a6bbb7-940a-447d-875a-d85482120035 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:08.016547 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-450450c8-6a17-4b5d-8cd9-053382ebde26 req-e3a6bbb7-940a-447d-875a-d85482120035 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:08.032119 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-450450c8-6a17-4b5d-8cd9-053382ebde26 req-e3a6bbb7-940a-447d-875a-d85482120035 service nova] Creating event network-vif-plugged:99141c24-9fad-4cf8-9d13-c4d90e5ddd88 for instance 85d3f4ae-60a5-4463-9a02-00d846d22289 on hv-cinder-84456 Oct 03 12:52:08.039674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-450450c8-6a17-4b5d-8cd9-053382ebde26 req-e3a6bbb7-940a-447d-875a-d85482120035 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067491 Oct 03 12:52:08.041005 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 170/337] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:52:08.058574 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-4c3a85bf-001a-40a5-9157-4b09a10b9831 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:08.060978 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-4c3a85bf-001a-40a5-9157-4b09a10b9831 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:08.069152 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4c3a85bf-001a-40a5-9157-4b09a10b9831 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:08.069783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4c3a85bf-001a-40a5-9157-4b09a10b9831 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:08.070479 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4c3a85bf-001a-40a5-9157-4b09a10b9831 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:08.071399 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4c3a85bf-001a-40a5-9157-4b09a10b9831 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:08.072648 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4c3a85bf-001a-40a5-9157-4b09a10b9831 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:08.073179 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4c3a85bf-001a-40a5-9157-4b09a10b9831 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:08.090542 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-ec6c01ee-e478-49b9-9dc7-0a03ac035e8f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:08.102618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-ec6c01ee-e478-49b9-9dc7-0a03ac035e8f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.329444 Oct 03 12:52:08.103459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 168/338] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:07 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:08.246464 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4c3a85bf-001a-40a5-9157-4b09a10b9831 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:08.258004 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-4c3a85bf-001a-40a5-9157-4b09a10b9831 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.215602 Oct 03 12:52:08.258922 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 171/339] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:08 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:08.976973 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-010ef050-90ee-43c0-b506-ef5669bebed8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:08.977611 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-010ef050-90ee-43c0-b506-ef5669bebed8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:08.984127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-010ef050-90ee-43c0-b506-ef5669bebed8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:08.984607 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-010ef050-90ee-43c0-b506-ef5669bebed8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:08.985038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-010ef050-90ee-43c0-b506-ef5669bebed8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:08.985721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-010ef050-90ee-43c0-b506-ef5669bebed8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:08.986172 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-010ef050-90ee-43c0-b506-ef5669bebed8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:08.986594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-010ef050-90ee-43c0-b506-ef5669bebed8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:09.115568 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-010ef050-90ee-43c0-b506-ef5669bebed8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:09.124120 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-010ef050-90ee-43c0-b506-ef5669bebed8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:09.125612 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-010ef050-90ee-43c0-b506-ef5669bebed8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:09.125756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ab3eb711-f65e-48d9-86cd-5f6f1e5a08ad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:09.126228 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ab3eb711-f65e-48d9-86cd-5f6f1e5a08ad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:09.126779 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-010ef050-90ee-43c0-b506-ef5669bebed8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1745 microversion: 2.20 time: 0.153922 Oct 03 12:52:09.127341 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 169/340] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:08 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:09.133029 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ab3eb711-f65e-48d9-86cd-5f6f1e5a08ad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:09.133517 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ab3eb711-f65e-48d9-86cd-5f6f1e5a08ad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:09.133955 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ab3eb711-f65e-48d9-86cd-5f6f1e5a08ad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:09.134648 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ab3eb711-f65e-48d9-86cd-5f6f1e5a08ad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:09.135104 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ab3eb711-f65e-48d9-86cd-5f6f1e5a08ad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:09.135557 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ab3eb711-f65e-48d9-86cd-5f6f1e5a08ad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:09.263433 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-ab3eb711-f65e-48d9-86cd-5f6f1e5a08ad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:09.271055 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ab3eb711-f65e-48d9-86cd-5f6f1e5a08ad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.149200 Oct 03 12:52:09.271657 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 172/341] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:09 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:52:09.285897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-2af67965-6a3d-4e69-ad5e-77114f52a7db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:09.286514 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-2af67965-6a3d-4e69-ad5e-77114f52a7db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:09.292480 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2af67965-6a3d-4e69-ad5e-77114f52a7db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:09.292972 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2af67965-6a3d-4e69-ad5e-77114f52a7db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:09.293409 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2af67965-6a3d-4e69-ad5e-77114f52a7db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:09.294100 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2af67965-6a3d-4e69-ad5e-77114f52a7db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:09.294553 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2af67965-6a3d-4e69-ad5e-77114f52a7db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:09.294981 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2af67965-6a3d-4e69-ad5e-77114f52a7db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:09.428089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-2af67965-6a3d-4e69-ad5e-77114f52a7db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:09.436273 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-2af67965-6a3d-4e69-ad5e-77114f52a7db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.154246 Oct 03 12:52:09.441097 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 170/342] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:09 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:10.152415 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8489bd55-56b3-4eff-abef-1c23707954b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:10.153059 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8489bd55-56b3-4eff-abef-1c23707954b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:10.159000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8489bd55-56b3-4eff-abef-1c23707954b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:10.159500 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8489bd55-56b3-4eff-abef-1c23707954b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:10.159941 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8489bd55-56b3-4eff-abef-1c23707954b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:10.161155 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8489bd55-56b3-4eff-abef-1c23707954b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:10.161714 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8489bd55-56b3-4eff-abef-1c23707954b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:10.162140 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8489bd55-56b3-4eff-abef-1c23707954b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:10.294118 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a5df7c1d-73bd-448b-ad62-c6134a5b521f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:10.294746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a5df7c1d-73bd-448b-ad62-c6134a5b521f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:10.295344 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8489bd55-56b3-4eff-abef-1c23707954b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:10.301973 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a5df7c1d-73bd-448b-ad62-c6134a5b521f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:10.302432 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a5df7c1d-73bd-448b-ad62-c6134a5b521f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:10.302868 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a5df7c1d-73bd-448b-ad62-c6134a5b521f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:10.303639 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a5df7c1d-73bd-448b-ad62-c6134a5b521f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:10.304092 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a5df7c1d-73bd-448b-ad62-c6134a5b521f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:10.304519 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a5df7c1d-73bd-448b-ad62-c6134a5b521f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:10.304856 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8489bd55-56b3-4eff-abef-1c23707954b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:10.306315 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8489bd55-56b3-4eff-abef-1c23707954b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:10.307519 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-8489bd55-56b3-4eff-abef-1c23707954b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1745 microversion: 2.20 time: 0.159073 Oct 03 12:52:10.308082 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 173/343] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:10 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:10.433618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a5df7c1d-73bd-448b-ad62-c6134a5b521f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:10.441308 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a5df7c1d-73bd-448b-ad62-c6134a5b521f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.151282 Oct 03 12:52:10.442023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 171/344] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:10 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:52:10.460111 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-091f5998-e10b-4dde-b715-0b64c668edf9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:10.460723 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-091f5998-e10b-4dde-b715-0b64c668edf9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:10.466672 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-091f5998-e10b-4dde-b715-0b64c668edf9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:10.467157 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-091f5998-e10b-4dde-b715-0b64c668edf9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:10.467624 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-091f5998-e10b-4dde-b715-0b64c668edf9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:10.468315 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-091f5998-e10b-4dde-b715-0b64c668edf9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:10.468771 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-091f5998-e10b-4dde-b715-0b64c668edf9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:10.469197 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-091f5998-e10b-4dde-b715-0b64c668edf9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:10.601292 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-091f5998-e10b-4dde-b715-0b64c668edf9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:10.609429 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-091f5998-e10b-4dde-b715-0b64c668edf9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.153250 Oct 03 12:52:10.609989 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 174/345] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:10 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:11.345697 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e343e6f2-9f82-4dcd-bc21-3587c5901e92 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:11.345697 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e343e6f2-9f82-4dcd-bc21-3587c5901e92 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:11.352263 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e343e6f2-9f82-4dcd-bc21-3587c5901e92 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:11.352817 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e343e6f2-9f82-4dcd-bc21-3587c5901e92 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:11.353250 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e343e6f2-9f82-4dcd-bc21-3587c5901e92 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:11.353993 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e343e6f2-9f82-4dcd-bc21-3587c5901e92 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:11.354456 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e343e6f2-9f82-4dcd-bc21-3587c5901e92 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:11.354885 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e343e6f2-9f82-4dcd-bc21-3587c5901e92 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:11.470707 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-26ccd8f9-45ba-4a8e-9bfa-2955aa2b45c5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:11.471541 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-26ccd8f9-45ba-4a8e-9bfa-2955aa2b45c5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:11.481085 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-26ccd8f9-45ba-4a8e-9bfa-2955aa2b45c5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:11.494349 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-26ccd8f9-45ba-4a8e-9bfa-2955aa2b45c5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:11.495399 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-26ccd8f9-45ba-4a8e-9bfa-2955aa2b45c5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:11.498049 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-26ccd8f9-45ba-4a8e-9bfa-2955aa2b45c5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:11.498791 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-26ccd8f9-45ba-4a8e-9bfa-2955aa2b45c5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:11.500141 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-26ccd8f9-45ba-4a8e-9bfa-2955aa2b45c5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:11.603702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e343e6f2-9f82-4dcd-bc21-3587c5901e92 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:11.639016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e343e6f2-9f82-4dcd-bc21-3587c5901e92 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:11.642137 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e343e6f2-9f82-4dcd-bc21-3587c5901e92 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:11.642137 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e343e6f2-9f82-4dcd-bc21-3587c5901e92 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1745 microversion: 2.20 time: 0.311127 Oct 03 12:52:11.642718 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 172/346] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:11 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1745 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:11.647844 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-124c9619-1e5c-4a1a-8018-5587394fa361 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:11.648704 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-124c9619-1e5c-4a1a-8018-5587394fa361 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:11.659117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-124c9619-1e5c-4a1a-8018-5587394fa361 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:11.659894 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-124c9619-1e5c-4a1a-8018-5587394fa361 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:11.661862 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-124c9619-1e5c-4a1a-8018-5587394fa361 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:11.663036 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-124c9619-1e5c-4a1a-8018-5587394fa361 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:11.663720 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-124c9619-1e5c-4a1a-8018-5587394fa361 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:11.664536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-124c9619-1e5c-4a1a-8018-5587394fa361 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:11.849170 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-26ccd8f9-45ba-4a8e-9bfa-2955aa2b45c5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:11.859819 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-26ccd8f9-45ba-4a8e-9bfa-2955aa2b45c5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.399742 Oct 03 12:52:11.866969 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 175/347] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:11 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:11.917426 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-124c9619-1e5c-4a1a-8018-5587394fa361 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:11.926693 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-124c9619-1e5c-4a1a-8018-5587394fa361 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.282256 Oct 03 12:52:11.928000 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 173/348] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:11 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:12.463246 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-434ee992-3829-4bd0-b7b7-fa51c80f3258 req-df9f15fa-7d35-4e0d-a22c-841e16d12854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54982238-81ba-4d23-b642-e3a37f778b4a", "name": "network-vif-plugged", "status": "completed", "tag": "e846a01d-6972-40c0-b292-bc930ec8ca6d"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:52:12.476045 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:12.479897 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-434ee992-3829-4bd0-b7b7-fa51c80f3258 req-df9f15fa-7d35-4e0d-a22c-841e16d12854 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:12.481862 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-434ee992-3829-4bd0-b7b7-fa51c80f3258 req-df9f15fa-7d35-4e0d-a22c-841e16d12854 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:12.482610 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-434ee992-3829-4bd0-b7b7-fa51c80f3258 req-df9f15fa-7d35-4e0d-a22c-841e16d12854 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:12.502656 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-434ee992-3829-4bd0-b7b7-fa51c80f3258 req-df9f15fa-7d35-4e0d-a22c-841e16d12854 service nova] Creating event network-vif-plugged:e846a01d-6972-40c0-b292-bc930ec8ca6d for instance 54982238-81ba-4d23-b642-e3a37f778b4a on hv-cinder-84456 Oct 03 12:52:12.512213 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-434ee992-3829-4bd0-b7b7-fa51c80f3258 req-df9f15fa-7d35-4e0d-a22c-841e16d12854 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055494 Oct 03 12:52:12.514980 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 176/349] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:52:12.668661 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8f5ec6dc-1364-4ab5-9031-616bb20fb453 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:12.669308 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8f5ec6dc-1364-4ab5-9031-616bb20fb453 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:12.679261 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:12.682577 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8f5ec6dc-1364-4ab5-9031-616bb20fb453 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:12.683243 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8f5ec6dc-1364-4ab5-9031-616bb20fb453 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:12.683875 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8f5ec6dc-1364-4ab5-9031-616bb20fb453 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:12.684879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8f5ec6dc-1364-4ab5-9031-616bb20fb453 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:12.685526 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8f5ec6dc-1364-4ab5-9031-616bb20fb453 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:12.686111 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8f5ec6dc-1364-4ab5-9031-616bb20fb453 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:12.885328 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-5eb5e094-d066-4a8a-8a01-40d6afc1b19a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:12.886148 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-5eb5e094-d066-4a8a-8a01-40d6afc1b19a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:12.903887 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5eb5e094-d066-4a8a-8a01-40d6afc1b19a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:12.904383 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5eb5e094-d066-4a8a-8a01-40d6afc1b19a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:12.904825 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5eb5e094-d066-4a8a-8a01-40d6afc1b19a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:12.905538 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5eb5e094-d066-4a8a-8a01-40d6afc1b19a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:12.906000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5eb5e094-d066-4a8a-8a01-40d6afc1b19a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:12.906546 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5eb5e094-d066-4a8a-8a01-40d6afc1b19a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:12.912642 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8f5ec6dc-1364-4ab5-9031-616bb20fb453 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:12.927064 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8f5ec6dc-1364-4ab5-9031-616bb20fb453 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:12.929298 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8f5ec6dc-1364-4ab5-9031-616bb20fb453 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:12.930703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8f5ec6dc-1364-4ab5-9031-616bb20fb453 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.265920 Oct 03 12:52:12.931817 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 174/350] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:12 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:12.952688 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-99065847-4d67-4e4c-b230-30bd5865802d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:12.953585 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-99065847-4d67-4e4c-b230-30bd5865802d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:12.974396 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99065847-4d67-4e4c-b230-30bd5865802d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:12.975925 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99065847-4d67-4e4c-b230-30bd5865802d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:12.976568 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99065847-4d67-4e4c-b230-30bd5865802d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:12.990544 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99065847-4d67-4e4c-b230-30bd5865802d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:12.990544 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99065847-4d67-4e4c-b230-30bd5865802d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:12.990544 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99065847-4d67-4e4c-b230-30bd5865802d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:13.265720 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5eb5e094-d066-4a8a-8a01-40d6afc1b19a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:13.276860 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-5eb5e094-d066-4a8a-8a01-40d6afc1b19a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1370 microversion: 2.1 time: 0.396172 Oct 03 12:52:13.286892 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-99065847-4d67-4e4c-b230-30bd5865802d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:13.293304 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 177/351] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:12 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1370 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:52:13.298595 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-99065847-4d67-4e4c-b230-30bd5865802d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.350145 Oct 03 12:52:13.300228 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 175/352] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:12 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:52:13.958316 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2118032a-f5aa-4016-8545-8363e0853e80 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:13.958841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2118032a-f5aa-4016-8545-8363e0853e80 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:13.964989 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2118032a-f5aa-4016-8545-8363e0853e80 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:13.966223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2118032a-f5aa-4016-8545-8363e0853e80 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:13.966664 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2118032a-f5aa-4016-8545-8363e0853e80 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:13.967794 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2118032a-f5aa-4016-8545-8363e0853e80 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:13.968256 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2118032a-f5aa-4016-8545-8363e0853e80 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:13.968683 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2118032a-f5aa-4016-8545-8363e0853e80 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:13.986551 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=100 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:14.127963 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2118032a-f5aa-4016-8545-8363e0853e80 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:14.136829 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2118032a-f5aa-4016-8545-8363e0853e80 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:14.138510 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2118032a-f5aa-4016-8545-8363e0853e80 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:14.139735 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-2118032a-f5aa-4016-8545-8363e0853e80 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.185587 Oct 03 12:52:14.140476 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 178/353] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:13 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:14.300659 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c6f0c5fa-0522-4c5f-91f3-90426eaa133b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:14.303110 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c6f0c5fa-0522-4c5f-91f3-90426eaa133b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:14.310132 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c6f0c5fa-0522-4c5f-91f3-90426eaa133b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:14.310849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c6f0c5fa-0522-4c5f-91f3-90426eaa133b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:14.311572 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c6f0c5fa-0522-4c5f-91f3-90426eaa133b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:14.312547 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c6f0c5fa-0522-4c5f-91f3-90426eaa133b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:14.313418 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c6f0c5fa-0522-4c5f-91f3-90426eaa133b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:14.314010 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c6f0c5fa-0522-4c5f-91f3-90426eaa133b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:14.331741 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-24bcf30a-83f9-48c0-aaed-777d41466e77 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:14.333510 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-24bcf30a-83f9-48c0-aaed-777d41466e77 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:14.368884 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24bcf30a-83f9-48c0-aaed-777d41466e77 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:14.369439 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24bcf30a-83f9-48c0-aaed-777d41466e77 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:14.370105 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24bcf30a-83f9-48c0-aaed-777d41466e77 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:14.371226 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24bcf30a-83f9-48c0-aaed-777d41466e77 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:14.373159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24bcf30a-83f9-48c0-aaed-777d41466e77 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:14.373888 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24bcf30a-83f9-48c0-aaed-777d41466e77 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:14.576026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c6f0c5fa-0522-4c5f-91f3-90426eaa133b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:14.586859 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c6f0c5fa-0522-4c5f-91f3-90426eaa133b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1565 microversion: 2.1 time: 0.290220 Oct 03 12:52:14.587873 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 176/354] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:14 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1565 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:52:14.612087 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f3c479ec-1fbf-4d3b-96ee-1796fa2528ce tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:14.612850 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f3c479ec-1fbf-4d3b-96ee-1796fa2528ce tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:14.618038 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-24bcf30a-83f9-48c0-aaed-777d41466e77 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:14.627695 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-24bcf30a-83f9-48c0-aaed-777d41466e77 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.301684 Oct 03 12:52:14.637094 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 179/355] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:14 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:52:14.639742 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3c479ec-1fbf-4d3b-96ee-1796fa2528ce tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:14.641379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3c479ec-1fbf-4d3b-96ee-1796fa2528ce tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:14.642180 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3c479ec-1fbf-4d3b-96ee-1796fa2528ce tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:14.643111 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3c479ec-1fbf-4d3b-96ee-1796fa2528ce tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:14.644131 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3c479ec-1fbf-4d3b-96ee-1796fa2528ce tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:14.646586 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3c479ec-1fbf-4d3b-96ee-1796fa2528ce tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:14.733489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f3c479ec-1fbf-4d3b-96ee-1796fa2528ce tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125293 Oct 03 12:52:14.734075 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 177/356] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Oct 3 12:52:14 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:52:15.173981 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bd950bda-afcd-47ba-8826-4797f1de7dd7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:15.174665 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-bd950bda-afcd-47ba-8826-4797f1de7dd7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:15.181392 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bd950bda-afcd-47ba-8826-4797f1de7dd7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:15.181881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bd950bda-afcd-47ba-8826-4797f1de7dd7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:15.182314 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bd950bda-afcd-47ba-8826-4797f1de7dd7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:15.183015 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bd950bda-afcd-47ba-8826-4797f1de7dd7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:15.183515 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bd950bda-afcd-47ba-8826-4797f1de7dd7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:15.183940 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bd950bda-afcd-47ba-8826-4797f1de7dd7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:15.391526 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-bd950bda-afcd-47ba-8826-4797f1de7dd7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:15.404079 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-bd950bda-afcd-47ba-8826-4797f1de7dd7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:15.407596 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-bd950bda-afcd-47ba-8826-4797f1de7dd7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:15.407596 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-bd950bda-afcd-47ba-8826-4797f1de7dd7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.236765 Oct 03 12:52:15.407596 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 180/357] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:15 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:15.657719 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-cbee2b5a-a9b9-43d2-a22a-44c9b298dbe0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:15.658341 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-cbee2b5a-a9b9-43d2-a22a-44c9b298dbe0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:15.665157 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cbee2b5a-a9b9-43d2-a22a-44c9b298dbe0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:15.665679 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cbee2b5a-a9b9-43d2-a22a-44c9b298dbe0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:15.666165 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cbee2b5a-a9b9-43d2-a22a-44c9b298dbe0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:15.666872 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cbee2b5a-a9b9-43d2-a22a-44c9b298dbe0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:15.667350 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cbee2b5a-a9b9-43d2-a22a-44c9b298dbe0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:15.667785 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cbee2b5a-a9b9-43d2-a22a-44c9b298dbe0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:15.831912 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-8a000744-6c4f-4632-b792-0f0f896371cf req-e947449d-8050-49ae-a6a3-1ff7dc6ce4cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d3f4ae-60a5-4463-9a02-00d846d22289", "tag": "99141c24-9fad-4cf8-9d13-c4d90e5ddd88"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:52:15.840293 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-cbee2b5a-a9b9-43d2-a22a-44c9b298dbe0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:15.844174 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-8a000744-6c4f-4632-b792-0f0f896371cf req-e947449d-8050-49ae-a6a3-1ff7dc6ce4cd service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:15.844742 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-8a000744-6c4f-4632-b792-0f0f896371cf req-e947449d-8050-49ae-a6a3-1ff7dc6ce4cd service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:15.845254 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-8a000744-6c4f-4632-b792-0f0f896371cf req-e947449d-8050-49ae-a6a3-1ff7dc6ce4cd service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:15.850615 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-cbee2b5a-a9b9-43d2-a22a-44c9b298dbe0 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.197801 Oct 03 12:52:15.851416 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 178/358] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:15 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:15.859778 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-8a000744-6c4f-4632-b792-0f0f896371cf req-e947449d-8050-49ae-a6a3-1ff7dc6ce4cd service nova] Creating event network-changed:99141c24-9fad-4cf8-9d13-c4d90e5ddd88 for instance 85d3f4ae-60a5-4463-9a02-00d846d22289 on hv-cinder-84456 Oct 03 12:52:15.865600 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-8a000744-6c4f-4632-b792-0f0f896371cf req-e947449d-8050-49ae-a6a3-1ff7dc6ce4cd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038177 Oct 03 12:52:15.866996 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 181/359] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:52:16.436039 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-37a24f27-65d6-474c-9be1-ade2a52c264a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:16.436704 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-37a24f27-65d6-474c-9be1-ade2a52c264a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:16.443447 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37a24f27-65d6-474c-9be1-ade2a52c264a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:16.449338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37a24f27-65d6-474c-9be1-ade2a52c264a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:16.449338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37a24f27-65d6-474c-9be1-ade2a52c264a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:16.449338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37a24f27-65d6-474c-9be1-ade2a52c264a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:16.449338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37a24f27-65d6-474c-9be1-ade2a52c264a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:16.449774 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37a24f27-65d6-474c-9be1-ade2a52c264a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:16.614927 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-37a24f27-65d6-474c-9be1-ade2a52c264a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:16.623927 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-37a24f27-65d6-474c-9be1-ade2a52c264a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:16.626314 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-37a24f27-65d6-474c-9be1-ade2a52c264a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:16.627651 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-37a24f27-65d6-474c-9be1-ade2a52c264a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.196233 Oct 03 12:52:16.639341 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 179/360] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:16 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:16.875509 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2f9dcaed-9066-4bd4-b79d-bc9b2e7b116f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:16.876844 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2f9dcaed-9066-4bd4-b79d-bc9b2e7b116f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:16.884890 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f9dcaed-9066-4bd4-b79d-bc9b2e7b116f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:16.885385 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f9dcaed-9066-4bd4-b79d-bc9b2e7b116f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:16.885830 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f9dcaed-9066-4bd4-b79d-bc9b2e7b116f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:16.886574 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f9dcaed-9066-4bd4-b79d-bc9b2e7b116f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:16.887055 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f9dcaed-9066-4bd4-b79d-bc9b2e7b116f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:16.887513 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f9dcaed-9066-4bd4-b79d-bc9b2e7b116f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:17.054580 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2f9dcaed-9066-4bd4-b79d-bc9b2e7b116f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:17.065928 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-2f9dcaed-9066-4bd4-b79d-bc9b2e7b116f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1723 microversion: 2.1 time: 0.195260 Oct 03 12:52:17.067466 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 182/361] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:16 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:17.658214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-92821da5-478e-41ea-8edd-34aeff494618 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:17.659495 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-92821da5-478e-41ea-8edd-34aeff494618 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:17.668304 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-92821da5-478e-41ea-8edd-34aeff494618 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:17.669050 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-92821da5-478e-41ea-8edd-34aeff494618 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:17.669488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-92821da5-478e-41ea-8edd-34aeff494618 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:17.670451 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-92821da5-478e-41ea-8edd-34aeff494618 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:17.671067 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-92821da5-478e-41ea-8edd-34aeff494618 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:17.671826 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-92821da5-478e-41ea-8edd-34aeff494618 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:17.853991 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-92821da5-478e-41ea-8edd-34aeff494618 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:17.865010 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-92821da5-478e-41ea-8edd-34aeff494618 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:17.872510 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-92821da5-478e-41ea-8edd-34aeff494618 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:17.877177 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-92821da5-478e-41ea-8edd-34aeff494618 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.222133 Oct 03 12:52:17.877829 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 180/362] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:17 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:18.093690 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-6d055da1-4d66-4473-8933-4a241abe1cd3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:18.096486 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-6d055da1-4d66-4473-8933-4a241abe1cd3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:18.106245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6d055da1-4d66-4473-8933-4a241abe1cd3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:18.106748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6d055da1-4d66-4473-8933-4a241abe1cd3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:18.107602 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6d055da1-4d66-4473-8933-4a241abe1cd3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:18.108566 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6d055da1-4d66-4473-8933-4a241abe1cd3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:18.109208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6d055da1-4d66-4473-8933-4a241abe1cd3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:18.109789 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6d055da1-4d66-4473-8933-4a241abe1cd3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:18.287041 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-6d055da1-4d66-4473-8933-4a241abe1cd3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:18.296456 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-6d055da1-4d66-4473-8933-4a241abe1cd3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1700 microversion: 2.1 time: 0.207673 Oct 03 12:52:18.297085 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 183/363] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:18 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1700 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:18.320441 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f79fc5e5-d0dd-4a88-bcb7-4deec7f69369 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:52:18.327678 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f79fc5e5-d0dd-4a88-bcb7-4deec7f69369 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:18.328922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f79fc5e5-d0dd-4a88-bcb7-4deec7f69369 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:18.329631 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f79fc5e5-d0dd-4a88-bcb7-4deec7f69369 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:18.357898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f79fc5e5-d0dd-4a88-bcb7-4deec7f69369 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Going to try to start instance {{(pid=127542) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 12:52:18.569951 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f79fc5e5-d0dd-4a88-bcb7-4deec7f69369 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "POST /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/action" status: 202 len: 0 microversion: 2.1 time: 0.254113 Oct 03 12:52:18.571356 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 181/364] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 12:52:18 2022] POST /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:52:18.580883 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-dfb80c48-67db-4a35-aea6-6bdc72a56e38 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:18.581952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-dfb80c48-67db-4a35-aea6-6bdc72a56e38 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:18.591541 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dfb80c48-67db-4a35-aea6-6bdc72a56e38 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:18.596501 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dfb80c48-67db-4a35-aea6-6bdc72a56e38 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:18.596501 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dfb80c48-67db-4a35-aea6-6bdc72a56e38 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:18.596501 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dfb80c48-67db-4a35-aea6-6bdc72a56e38 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:18.596501 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dfb80c48-67db-4a35-aea6-6bdc72a56e38 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:18.597057 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dfb80c48-67db-4a35-aea6-6bdc72a56e38 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:18.768294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-dfb80c48-67db-4a35-aea6-6bdc72a56e38 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:18.781220 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-dfb80c48-67db-4a35-aea6-6bdc72a56e38 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1709 microversion: 2.1 time: 0.204772 Oct 03 12:52:18.782126 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 184/365] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:18 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1709 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:18.907698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4a4582e4-bce0-4ae6-97b0-23176d94eef7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:18.908450 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-4a4582e4-bce0-4ae6-97b0-23176d94eef7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:18.917319 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4a4582e4-bce0-4ae6-97b0-23176d94eef7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:18.917830 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4a4582e4-bce0-4ae6-97b0-23176d94eef7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:18.918496 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4a4582e4-bce0-4ae6-97b0-23176d94eef7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:18.919211 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4a4582e4-bce0-4ae6-97b0-23176d94eef7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:18.919721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4a4582e4-bce0-4ae6-97b0-23176d94eef7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:18.920347 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4a4582e4-bce0-4ae6-97b0-23176d94eef7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:18.954344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:19.239918 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4a4582e4-bce0-4ae6-97b0-23176d94eef7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:19.251305 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4a4582e4-bce0-4ae6-97b0-23176d94eef7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:19.253813 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4a4582e4-bce0-4ae6-97b0-23176d94eef7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:19.257583 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-4a4582e4-bce0-4ae6-97b0-23176d94eef7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.354629 Oct 03 12:52:19.258963 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 182/366] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:18 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:19.809670 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-7a134f9f-5951-4cef-9ac9-809877533d68 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:19.813644 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-7a134f9f-5951-4cef-9ac9-809877533d68 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:19.821303 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7a134f9f-5951-4cef-9ac9-809877533d68 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:19.822003 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7a134f9f-5951-4cef-9ac9-809877533d68 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:19.822703 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7a134f9f-5951-4cef-9ac9-809877533d68 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:19.823830 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7a134f9f-5951-4cef-9ac9-809877533d68 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:19.824534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7a134f9f-5951-4cef-9ac9-809877533d68 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:19.825070 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7a134f9f-5951-4cef-9ac9-809877533d68 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:19.989644 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7a134f9f-5951-4cef-9ac9-809877533d68 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:19.998179 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-7a134f9f-5951-4cef-9ac9-809877533d68 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1709 microversion: 2.1 time: 0.194185 Oct 03 12:52:19.998768 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 185/367] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:19 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1709 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:20.292269 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c8727848-8c58-4008-b158-df42ffb0b71b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:20.292885 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c8727848-8c58-4008-b158-df42ffb0b71b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:20.300397 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c8727848-8c58-4008-b158-df42ffb0b71b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:20.301631 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c8727848-8c58-4008-b158-df42ffb0b71b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:20.302144 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c8727848-8c58-4008-b158-df42ffb0b71b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:20.302918 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c8727848-8c58-4008-b158-df42ffb0b71b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:20.303670 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c8727848-8c58-4008-b158-df42ffb0b71b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:20.304339 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c8727848-8c58-4008-b158-df42ffb0b71b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:20.462168 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c8727848-8c58-4008-b158-df42ffb0b71b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:20.470909 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c8727848-8c58-4008-b158-df42ffb0b71b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:20.472520 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c8727848-8c58-4008-b158-df42ffb0b71b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:20.473966 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c8727848-8c58-4008-b158-df42ffb0b71b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.186252 Oct 03 12:52:20.474525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 183/368] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:20 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:52:21.022659 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-923e1d64-d8cb-496d-9427-59b634f7f5d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:21.023484 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-923e1d64-d8cb-496d-9427-59b634f7f5d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:21.029556 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-923e1d64-d8cb-496d-9427-59b634f7f5d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:21.030316 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-923e1d64-d8cb-496d-9427-59b634f7f5d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:21.030760 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-923e1d64-d8cb-496d-9427-59b634f7f5d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:21.031503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-923e1d64-d8cb-496d-9427-59b634f7f5d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:21.032124 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-923e1d64-d8cb-496d-9427-59b634f7f5d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:21.032582 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-923e1d64-d8cb-496d-9427-59b634f7f5d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:21.201728 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-923e1d64-d8cb-496d-9427-59b634f7f5d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:21.205800 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-923e1d64-d8cb-496d-9427-59b634f7f5d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1709 microversion: 2.1 time: 0.187648 Oct 03 12:52:21.206568 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 186/369] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:21 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1709 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:21.505478 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-750870ec-d1b1-4d60-bef9-fe7090262203 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:21.508221 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-750870ec-d1b1-4d60-bef9-fe7090262203 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:21.515143 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-750870ec-d1b1-4d60-bef9-fe7090262203 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:21.515692 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-750870ec-d1b1-4d60-bef9-fe7090262203 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:21.516154 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-750870ec-d1b1-4d60-bef9-fe7090262203 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:21.516884 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-750870ec-d1b1-4d60-bef9-fe7090262203 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:21.517347 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-750870ec-d1b1-4d60-bef9-fe7090262203 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:21.517778 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-750870ec-d1b1-4d60-bef9-fe7090262203 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:21.738095 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-750870ec-d1b1-4d60-bef9-fe7090262203 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:21.747819 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-750870ec-d1b1-4d60-bef9-fe7090262203 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:21.749708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-750870ec-d1b1-4d60-bef9-fe7090262203 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:21.750889 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-750870ec-d1b1-4d60-bef9-fe7090262203 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.250339 Oct 03 12:52:21.751648 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 184/370] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:21 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:22.232051 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-92013594-ee56-4bdf-90e3-bdf75e445f84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:22.232881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-92013594-ee56-4bdf-90e3-bdf75e445f84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:22.239801 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92013594-ee56-4bdf-90e3-bdf75e445f84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:22.240621 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92013594-ee56-4bdf-90e3-bdf75e445f84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:22.243933 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92013594-ee56-4bdf-90e3-bdf75e445f84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:22.244840 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92013594-ee56-4bdf-90e3-bdf75e445f84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:22.245467 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92013594-ee56-4bdf-90e3-bdf75e445f84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:22.245894 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-92013594-ee56-4bdf-90e3-bdf75e445f84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:22.405153 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-92013594-ee56-4bdf-90e3-bdf75e445f84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:22.415463 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-92013594-ee56-4bdf-90e3-bdf75e445f84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1713 microversion: 2.1 time: 0.189634 Oct 03 12:52:22.416208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 187/371] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:22 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1713 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:22.777646 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a2fef3b1-c4c1-4502-8e9a-f212a7e3a825 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:22.778930 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a2fef3b1-c4c1-4502-8e9a-f212a7e3a825 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:22.786411 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a2fef3b1-c4c1-4502-8e9a-f212a7e3a825 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:22.787373 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a2fef3b1-c4c1-4502-8e9a-f212a7e3a825 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:22.787702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a2fef3b1-c4c1-4502-8e9a-f212a7e3a825 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:22.788586 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a2fef3b1-c4c1-4502-8e9a-f212a7e3a825 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:22.789046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a2fef3b1-c4c1-4502-8e9a-f212a7e3a825 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:22.789465 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a2fef3b1-c4c1-4502-8e9a-f212a7e3a825 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:22.962175 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a2fef3b1-c4c1-4502-8e9a-f212a7e3a825 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:22.976800 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a2fef3b1-c4c1-4502-8e9a-f212a7e3a825 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:22.979494 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a2fef3b1-c4c1-4502-8e9a-f212a7e3a825 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:22.980929 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a2fef3b1-c4c1-4502-8e9a-f212a7e3a825 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.207302 Oct 03 12:52:22.981598 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 185/372] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:22 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:24.007237 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-208f37fe-75b8-4eef-b38f-cc8f8ee4835e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:24.008301 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-208f37fe-75b8-4eef-b38f-cc8f8ee4835e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:24.016094 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-208f37fe-75b8-4eef-b38f-cc8f8ee4835e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:24.016691 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-208f37fe-75b8-4eef-b38f-cc8f8ee4835e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:24.017391 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-208f37fe-75b8-4eef-b38f-cc8f8ee4835e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:24.018291 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-208f37fe-75b8-4eef-b38f-cc8f8ee4835e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:24.018823 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-208f37fe-75b8-4eef-b38f-cc8f8ee4835e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:24.019474 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-208f37fe-75b8-4eef-b38f-cc8f8ee4835e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:24.205559 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-208f37fe-75b8-4eef-b38f-cc8f8ee4835e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:24.215748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-208f37fe-75b8-4eef-b38f-cc8f8ee4835e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:24.217375 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-208f37fe-75b8-4eef-b38f-cc8f8ee4835e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:24.218865 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-208f37fe-75b8-4eef-b38f-cc8f8ee4835e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.215706 Oct 03 12:52:24.219922 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 188/373] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:24 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:25.251769 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0ad3dce7-3558-4db1-b116-6adc59099969 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:25.254930 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-0ad3dce7-3558-4db1-b116-6adc59099969 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:25.275693 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ad3dce7-3558-4db1-b116-6adc59099969 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:25.276819 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ad3dce7-3558-4db1-b116-6adc59099969 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:25.278343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ad3dce7-3558-4db1-b116-6adc59099969 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:25.280145 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ad3dce7-3558-4db1-b116-6adc59099969 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:25.282235 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ad3dce7-3558-4db1-b116-6adc59099969 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:25.282897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ad3dce7-3558-4db1-b116-6adc59099969 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:25.481388 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0ad3dce7-3558-4db1-b116-6adc59099969 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:25.502535 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0ad3dce7-3558-4db1-b116-6adc59099969 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:25.505990 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0ad3dce7-3558-4db1-b116-6adc59099969 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:25.511110 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-0ad3dce7-3558-4db1-b116-6adc59099969 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.263510 Oct 03 12:52:25.513008 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 186/374] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:25 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:26.558740 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-968d825b-0a0a-4d7c-b14d-21ff5b446fd0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:26.560828 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-968d825b-0a0a-4d7c-b14d-21ff5b446fd0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:26.574796 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-968d825b-0a0a-4d7c-b14d-21ff5b446fd0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:26.575788 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-968d825b-0a0a-4d7c-b14d-21ff5b446fd0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:26.576388 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-968d825b-0a0a-4d7c-b14d-21ff5b446fd0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:26.577761 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-968d825b-0a0a-4d7c-b14d-21ff5b446fd0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:26.578552 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-968d825b-0a0a-4d7c-b14d-21ff5b446fd0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:26.583037 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-968d825b-0a0a-4d7c-b14d-21ff5b446fd0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:26.864302 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-968d825b-0a0a-4d7c-b14d-21ff5b446fd0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:26.881635 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-968d825b-0a0a-4d7c-b14d-21ff5b446fd0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:26.904568 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-968d825b-0a0a-4d7c-b14d-21ff5b446fd0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:26.907248 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-968d825b-0a0a-4d7c-b14d-21ff5b446fd0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.372963 Oct 03 12:52:26.909297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 189/375] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:26 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:27.940102 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-31e6d850-9f52-4533-9878-18067b450780 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:27.941396 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-31e6d850-9f52-4533-9878-18067b450780 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:27.948285 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-31e6d850-9f52-4533-9878-18067b450780 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:27.949130 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-31e6d850-9f52-4533-9878-18067b450780 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:27.949763 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-31e6d850-9f52-4533-9878-18067b450780 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:27.950800 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-31e6d850-9f52-4533-9878-18067b450780 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:27.951300 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-31e6d850-9f52-4533-9878-18067b450780 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:27.951759 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-31e6d850-9f52-4533-9878-18067b450780 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:28.159472 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-31e6d850-9f52-4533-9878-18067b450780 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:28.179852 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-31e6d850-9f52-4533-9878-18067b450780 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:28.182291 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-31e6d850-9f52-4533-9878-18067b450780 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:28.183843 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-31e6d850-9f52-4533-9878-18067b450780 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.248114 Oct 03 12:52:28.186646 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 187/376] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:27 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:29.217076 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-67c26a2b-341d-4990-a105-f5f2bb7d57f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:29.218548 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-67c26a2b-341d-4990-a105-f5f2bb7d57f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:29.225921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67c26a2b-341d-4990-a105-f5f2bb7d57f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:29.227365 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67c26a2b-341d-4990-a105-f5f2bb7d57f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:29.227365 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67c26a2b-341d-4990-a105-f5f2bb7d57f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:29.227837 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67c26a2b-341d-4990-a105-f5f2bb7d57f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:29.228436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67c26a2b-341d-4990-a105-f5f2bb7d57f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:29.228868 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67c26a2b-341d-4990-a105-f5f2bb7d57f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:29.438873 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-67c26a2b-341d-4990-a105-f5f2bb7d57f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:29.448907 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-67c26a2b-341d-4990-a105-f5f2bb7d57f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:29.451226 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-67c26a2b-341d-4990-a105-f5f2bb7d57f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:29.452718 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-67c26a2b-341d-4990-a105-f5f2bb7d57f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.243169 Oct 03 12:52:29.453517 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 190/377] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:29 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:30.483857 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-9073a825-57f2-4d1f-8b75-69d0710aebb9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:30.484473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-9073a825-57f2-4d1f-8b75-69d0710aebb9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:30.492095 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9073a825-57f2-4d1f-8b75-69d0710aebb9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:30.493460 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9073a825-57f2-4d1f-8b75-69d0710aebb9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:30.493460 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9073a825-57f2-4d1f-8b75-69d0710aebb9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:30.499123 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9073a825-57f2-4d1f-8b75-69d0710aebb9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:30.500075 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9073a825-57f2-4d1f-8b75-69d0710aebb9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:30.500707 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9073a825-57f2-4d1f-8b75-69d0710aebb9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:30.778519 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-9073a825-57f2-4d1f-8b75-69d0710aebb9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:30.803419 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-9073a825-57f2-4d1f-8b75-69d0710aebb9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:30.812016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-9073a825-57f2-4d1f-8b75-69d0710aebb9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:30.815618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-9073a825-57f2-4d1f-8b75-69d0710aebb9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.335384 Oct 03 12:52:30.822358 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 188/378] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:30 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:31.914244 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3f429dd9-6483-41b2-893e-12de7774e28c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:31.917077 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-3f429dd9-6483-41b2-893e-12de7774e28c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:31.939136 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f429dd9-6483-41b2-893e-12de7774e28c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:31.944948 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f429dd9-6483-41b2-893e-12de7774e28c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:31.947667 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f429dd9-6483-41b2-893e-12de7774e28c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:31.948642 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f429dd9-6483-41b2-893e-12de7774e28c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:31.951177 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f429dd9-6483-41b2-893e-12de7774e28c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:31.952704 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f429dd9-6483-41b2-893e-12de7774e28c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:32.264100 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3f429dd9-6483-41b2-893e-12de7774e28c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:32.294679 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3f429dd9-6483-41b2-893e-12de7774e28c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:32.300454 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3f429dd9-6483-41b2-893e-12de7774e28c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:32.308878 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-3f429dd9-6483-41b2-893e-12de7774e28c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.406912 Oct 03 12:52:32.324942 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 191/379] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:31 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:33.340530 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-76c7426f-7929-423b-9aa9-486da95c9ec9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:33.341178 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-76c7426f-7929-423b-9aa9-486da95c9ec9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:33.360887 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-76c7426f-7929-423b-9aa9-486da95c9ec9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:33.361341 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-76c7426f-7929-423b-9aa9-486da95c9ec9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:33.361959 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-76c7426f-7929-423b-9aa9-486da95c9ec9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:33.362900 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-76c7426f-7929-423b-9aa9-486da95c9ec9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:33.363422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-76c7426f-7929-423b-9aa9-486da95c9ec9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:33.363879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-76c7426f-7929-423b-9aa9-486da95c9ec9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:33.599654 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-76c7426f-7929-423b-9aa9-486da95c9ec9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:33.608176 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-76c7426f-7929-423b-9aa9-486da95c9ec9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:33.609937 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-76c7426f-7929-423b-9aa9-486da95c9ec9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:33.611106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-76c7426f-7929-423b-9aa9-486da95c9ec9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.274619 Oct 03 12:52:33.611937 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 189/380] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:33 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:34.644328 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2c7f0c5d-bbd7-467c-a30b-a2cf78ffa4bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:34.646336 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2c7f0c5d-bbd7-467c-a30b-a2cf78ffa4bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:34.655276 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2c7f0c5d-bbd7-467c-a30b-a2cf78ffa4bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:34.658574 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2c7f0c5d-bbd7-467c-a30b-a2cf78ffa4bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:34.659363 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2c7f0c5d-bbd7-467c-a30b-a2cf78ffa4bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:34.666287 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2c7f0c5d-bbd7-467c-a30b-a2cf78ffa4bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:34.667601 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2c7f0c5d-bbd7-467c-a30b-a2cf78ffa4bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:34.667601 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2c7f0c5d-bbd7-467c-a30b-a2cf78ffa4bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:34.846891 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2c7f0c5d-bbd7-467c-a30b-a2cf78ffa4bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:34.856814 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2c7f0c5d-bbd7-467c-a30b-a2cf78ffa4bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:34.858248 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2c7f0c5d-bbd7-467c-a30b-a2cf78ffa4bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:34.859788 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-2c7f0c5d-bbd7-467c-a30b-a2cf78ffa4bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.222662 Oct 03 12:52:34.875457 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 192/381] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:34 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:35.889220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-619a737a-e8e2-45a2-ad53-a0462a27ecb8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:35.889899 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-619a737a-e8e2-45a2-ad53-a0462a27ecb8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:35.898170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-619a737a-e8e2-45a2-ad53-a0462a27ecb8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:35.898668 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-619a737a-e8e2-45a2-ad53-a0462a27ecb8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:35.899111 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-619a737a-e8e2-45a2-ad53-a0462a27ecb8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:35.899851 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-619a737a-e8e2-45a2-ad53-a0462a27ecb8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:35.900327 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-619a737a-e8e2-45a2-ad53-a0462a27ecb8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:35.900749 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-619a737a-e8e2-45a2-ad53-a0462a27ecb8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:36.082869 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-619a737a-e8e2-45a2-ad53-a0462a27ecb8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:36.097585 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-619a737a-e8e2-45a2-ad53-a0462a27ecb8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:36.100744 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-619a737a-e8e2-45a2-ad53-a0462a27ecb8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:36.102087 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-619a737a-e8e2-45a2-ad53-a0462a27ecb8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.219870 Oct 03 12:52:36.104946 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 190/382] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:35 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:37.131343 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b50f6fa4-0737-40dd-90ad-50b8d265ad1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:37.132000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-b50f6fa4-0737-40dd-90ad-50b8d265ad1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:37.137933 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b50f6fa4-0737-40dd-90ad-50b8d265ad1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:37.138427 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b50f6fa4-0737-40dd-90ad-50b8d265ad1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:37.138960 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b50f6fa4-0737-40dd-90ad-50b8d265ad1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:37.139586 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b50f6fa4-0737-40dd-90ad-50b8d265ad1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:37.140046 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b50f6fa4-0737-40dd-90ad-50b8d265ad1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:37.140475 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b50f6fa4-0737-40dd-90ad-50b8d265ad1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:37.278707 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-b50f6fa4-0737-40dd-90ad-50b8d265ad1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:37.288456 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-b50f6fa4-0737-40dd-90ad-50b8d265ad1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:37.290171 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-b50f6fa4-0737-40dd-90ad-50b8d265ad1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:37.292065 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-b50f6fa4-0737-40dd-90ad-50b8d265ad1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.165895 Oct 03 12:52:37.293285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 193/383] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:37 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:38.327784 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f236ef77-3f9c-4db5-9a46-cccc08c921fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:38.329254 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f236ef77-3f9c-4db5-9a46-cccc08c921fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:38.339848 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f236ef77-3f9c-4db5-9a46-cccc08c921fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:38.340332 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f236ef77-3f9c-4db5-9a46-cccc08c921fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:38.340939 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f236ef77-3f9c-4db5-9a46-cccc08c921fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:38.341638 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f236ef77-3f9c-4db5-9a46-cccc08c921fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:38.342090 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f236ef77-3f9c-4db5-9a46-cccc08c921fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:38.342513 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f236ef77-3f9c-4db5-9a46-cccc08c921fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:38.480038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-f236ef77-3f9c-4db5-9a46-cccc08c921fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:38.512025 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-f236ef77-3f9c-4db5-9a46-cccc08c921fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:38.520152 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-f236ef77-3f9c-4db5-9a46-cccc08c921fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:38.521454 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f236ef77-3f9c-4db5-9a46-cccc08c921fb tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1740 microversion: 2.20 time: 0.207569 Oct 03 12:52:38.533163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 191/384] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:38 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:38.933575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1865107707", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-745508035", "security_groups": [{"name": "tempest-secgroup-smoke-797083645"}], "block_device_mapping_v2": [{"uuid": "c173fd2c-66e8-437c-bb1f-6d65a1f59330", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1ccd52b4-506d-483d-a4e0-802199d3659f"}]}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:52:39.058105 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.network.neutron [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] validate_networks() for [('1ccd52b4-506d-483d-a4e0-802199d3659f', None, None, None, None, None)] {{(pid=127544) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:52:39.453162 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Flavor limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:52:39.453767 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Image limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:52:39.454306 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Flavor pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:52:39.454937 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Image pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:52:39.455535 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:52:39.473451 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:39.476894 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:39.476894 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:39.477868 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:39.478620 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:39.479347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:39.499137 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Getting quotas for project 38d1778202d041b58934150c6af9685c. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:52:39.503603 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Getting quotas for user 7ffffa27986f461ebc10c23c3c9817f0 and project 38d1778202d041b58934150c6af9685c. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:52:39.548238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a675df83-bdea-4731-b516-2bd2d656fd0e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:39.548859 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a675df83-bdea-4731-b516-2bd2d656fd0e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:39.565622 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a675df83-bdea-4731-b516-2bd2d656fd0e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:39.566624 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a675df83-bdea-4731-b516-2bd2d656fd0e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:39.567093 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a675df83-bdea-4731-b516-2bd2d656fd0e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:39.567883 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a675df83-bdea-4731-b516-2bd2d656fd0e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:39.568361 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a675df83-bdea-4731-b516-2bd2d656fd0e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:39.568800 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a675df83-bdea-4731-b516-2bd2d656fd0e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:39.571623 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Going to run 1 instances... {{(pid=127544) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:52:39.574215 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c173fd2c-66e8-437c-bb1f-6d65a1f59330',volume_size=None,volume_type=None)] {{(pid=127544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:52:39.760319 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a675df83-bdea-4731-b516-2bd2d656fd0e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:39.768454 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a675df83-bdea-4731-b516-2bd2d656fd0e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:39.770681 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a675df83-bdea-4731-b516-2bd2d656fd0e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:39.771894 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a675df83-bdea-4731-b516-2bd2d656fd0e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1722 microversion: 2.20 time: 0.227611 Oct 03 12:52:39.772461 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 192/385] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:39 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:52:40.120166 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR oslo.messaging._drivers.impl_rabbit [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [912a3914-00ac-4aaf-9e1e-14e5a42facbe] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 12:52:40.804882 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c3e12318-2f3d-47e8-a44b-f76edf543994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:40.805553 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c3e12318-2f3d-47e8-a44b-f76edf543994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:40.813185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c3e12318-2f3d-47e8-a44b-f76edf543994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:40.813961 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c3e12318-2f3d-47e8-a44b-f76edf543994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:40.814399 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c3e12318-2f3d-47e8-a44b-f76edf543994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:40.815655 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c3e12318-2f3d-47e8-a44b-f76edf543994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:40.816727 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c3e12318-2f3d-47e8-a44b-f76edf543994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:40.817162 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c3e12318-2f3d-47e8-a44b-f76edf543994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:40.966454 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c3e12318-2f3d-47e8-a44b-f76edf543994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:40.975348 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c3e12318-2f3d-47e8-a44b-f76edf543994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:40.976943 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c3e12318-2f3d-47e8-a44b-f76edf543994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:40.978195 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c3e12318-2f3d-47e8-a44b-f76edf543994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1722 microversion: 2.20 time: 0.180490 Oct 03 12:52:40.978759 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 193/386] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:40 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:52:41.131836 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO oslo.messaging._drivers.impl_rabbit [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [912a3914-00ac-4aaf-9e1e-14e5a42facbe] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 33200. Oct 03 12:52:41.139217 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-96f60557-e881-4a70-b3da-25bb94e0747d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.209445 Oct 03 12:52:41.140952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 194/387] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:52:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 2212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:52:41.152952 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7f24db8c-3ed3-4b46-a8cb-68cb5ab9e1bb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:41.154095 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-7f24db8c-3ed3-4b46-a8cb-68cb5ab9e1bb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:41.239835 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-7f24db8c-3ed3-4b46-a8cb-68cb5ab9e1bb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:41.249221 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-7f24db8c-3ed3-4b46-a8cb-68cb5ab9e1bb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1094 microversion: 2.1 time: 0.101188 Oct 03 12:52:41.249797 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 194/388] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:41 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1094 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:42.005028 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-5c19c638-2e0f-4a19-bea3-2eb9dcaae34c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:42.005863 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-5c19c638-2e0f-4a19-bea3-2eb9dcaae34c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:42.014877 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c19c638-2e0f-4a19-bea3-2eb9dcaae34c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:42.015467 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c19c638-2e0f-4a19-bea3-2eb9dcaae34c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:42.015964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c19c638-2e0f-4a19-bea3-2eb9dcaae34c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:42.032500 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c19c638-2e0f-4a19-bea3-2eb9dcaae34c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:42.032500 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c19c638-2e0f-4a19-bea3-2eb9dcaae34c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:42.032500 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c19c638-2e0f-4a19-bea3-2eb9dcaae34c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:42.168988 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5c19c638-2e0f-4a19-bea3-2eb9dcaae34c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:42.177849 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5c19c638-2e0f-4a19-bea3-2eb9dcaae34c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:42.179435 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5c19c638-2e0f-4a19-bea3-2eb9dcaae34c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:42.180740 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-5c19c638-2e0f-4a19-bea3-2eb9dcaae34c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1722 microversion: 2.20 time: 0.180439 Oct 03 12:52:42.181298 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 195/389] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:41 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:42.272072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d858af51-6c9c-466a-8c68-901e56f74b7d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:42.272791 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d858af51-6c9c-466a-8c68-901e56f74b7d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:42.330298 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d858af51-6c9c-466a-8c68-901e56f74b7d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:42.338124 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d858af51-6c9c-466a-8c68-901e56f74b7d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1094 microversion: 2.1 time: 0.069875 Oct 03 12:52:42.340232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 195/390] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:42 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:42.492190 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-25859ef0-349f-4a9e-9218-b50cf41bb1b1 req-5ecdacb8-064c-42a2-a72d-1a475bf7d965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54982238-81ba-4d23-b642-e3a37f778b4a", "name": "network-vif-unplugged", "status": "completed", "tag": "e846a01d-6972-40c0-b292-bc930ec8ca6d"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:52:42.502603 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-25859ef0-349f-4a9e-9218-b50cf41bb1b1 req-5ecdacb8-064c-42a2-a72d-1a475bf7d965 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:42.503075 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-25859ef0-349f-4a9e-9218-b50cf41bb1b1 req-5ecdacb8-064c-42a2-a72d-1a475bf7d965 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:42.503600 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-25859ef0-349f-4a9e-9218-b50cf41bb1b1 req-5ecdacb8-064c-42a2-a72d-1a475bf7d965 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:42.516592 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-25859ef0-349f-4a9e-9218-b50cf41bb1b1 req-5ecdacb8-064c-42a2-a72d-1a475bf7d965 service nova] Creating event network-vif-unplugged:e846a01d-6972-40c0-b292-bc930ec8ca6d for instance 54982238-81ba-4d23-b642-e3a37f778b4a on hv-cinder-84456 Oct 03 12:52:42.522503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-25859ef0-349f-4a9e-9218-b50cf41bb1b1 req-5ecdacb8-064c-42a2-a72d-1a475bf7d965 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037435 Oct 03 12:52:42.523127 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 196/391] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:52:43.207556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0af28e00-871f-4b81-8cf6-3bce611cad2d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:43.208090 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-0af28e00-871f-4b81-8cf6-3bce611cad2d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:43.209909 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=48 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:43.214469 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0af28e00-871f-4b81-8cf6-3bce611cad2d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:43.214949 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0af28e00-871f-4b81-8cf6-3bce611cad2d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:43.215412 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0af28e00-871f-4b81-8cf6-3bce611cad2d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:43.219017 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0af28e00-871f-4b81-8cf6-3bce611cad2d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:43.219017 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0af28e00-871f-4b81-8cf6-3bce611cad2d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:43.219017 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0af28e00-871f-4b81-8cf6-3bce611cad2d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:43.358958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0af28e00-871f-4b81-8cf6-3bce611cad2d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:43.364279 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3aaf7a1c-2402-43ee-873a-3a9e95e31952 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:43.365018 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-3aaf7a1c-2402-43ee-873a-3a9e95e31952 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:43.367353 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:43.368012 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0af28e00-871f-4b81-8cf6-3bce611cad2d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:43.369498 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0af28e00-871f-4b81-8cf6-3bce611cad2d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:43.370711 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-0af28e00-871f-4b81-8cf6-3bce611cad2d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1725 microversion: 2.20 time: 0.167705 Oct 03 12:52:43.371302 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 196/392] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:43 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:43.376636 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3aaf7a1c-2402-43ee-873a-3a9e95e31952 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:43.377474 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3aaf7a1c-2402-43ee-873a-3a9e95e31952 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:43.379388 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3aaf7a1c-2402-43ee-873a-3a9e95e31952 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:43.380252 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3aaf7a1c-2402-43ee-873a-3a9e95e31952 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:43.380781 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3aaf7a1c-2402-43ee-873a-3a9e95e31952 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:43.381408 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3aaf7a1c-2402-43ee-873a-3a9e95e31952 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:43.384728 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=100 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:43.403611 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d283866e-7c10-478f-848a-d4887667aa8a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccdd4e95-85ed-430f-ab7b-2316a95790da"}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:52:43.406024 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d283866e-7c10-478f-848a-d4887667aa8a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:43.412363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d283866e-7c10-478f-848a-d4887667aa8a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:43.412848 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d283866e-7c10-478f-848a-d4887667aa8a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:43.413457 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d283866e-7c10-478f-848a-d4887667aa8a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:43.414052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d283866e-7c10-478f-848a-d4887667aa8a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:43.414509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d283866e-7c10-478f-848a-d4887667aa8a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:43.414927 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d283866e-7c10-478f-848a-d4887667aa8a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:43.466729 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3aaf7a1c-2402-43ee-873a-3a9e95e31952 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:43.475961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-3aaf7a1c-2402-43ee-873a-3a9e95e31952 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1136 microversion: 2.1 time: 0.116602 Oct 03 12:52:43.476690 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 197/393] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:43 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1136 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:52:44.512505 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-7cd7b5ff-fad3-4a31-a025-f641902ee57c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:44.513147 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-7cd7b5ff-fad3-4a31-a025-f641902ee57c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:44.522653 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7cd7b5ff-fad3-4a31-a025-f641902ee57c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:44.523149 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7cd7b5ff-fad3-4a31-a025-f641902ee57c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:44.523608 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7cd7b5ff-fad3-4a31-a025-f641902ee57c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:44.524896 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7cd7b5ff-fad3-4a31-a025-f641902ee57c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:44.525356 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7cd7b5ff-fad3-4a31-a025-f641902ee57c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:44.525783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7cd7b5ff-fad3-4a31-a025-f641902ee57c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:44.602639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7cd7b5ff-fad3-4a31-a025-f641902ee57c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:44.613698 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-7cd7b5ff-fad3-4a31-a025-f641902ee57c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1210 microversion: 2.1 time: 0.105222 Oct 03 12:52:44.614404 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 198/394] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:44 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:44.792624 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d283866e-7c10-478f-848a-d4887667aa8a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "POST /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.392835 Oct 03 12:52:44.797354 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 197/395] 10.222.0.33 () {62 vars in 1364 bytes} [Mon Oct 3 12:52:43 2022] POST /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/os-volume_attachments => generated 188 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 12:52:44.937122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b160a981-90f0-4d1c-8bcb-d3db7c1abb14 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:52:44.937747 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-b160a981-90f0-4d1c-8bcb-d3db7c1abb14 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:44.944795 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b160a981-90f0-4d1c-8bcb-d3db7c1abb14 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:44.945287 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b160a981-90f0-4d1c-8bcb-d3db7c1abb14 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:44.945727 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b160a981-90f0-4d1c-8bcb-d3db7c1abb14 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:44.946422 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b160a981-90f0-4d1c-8bcb-d3db7c1abb14 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:44.946875 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b160a981-90f0-4d1c-8bcb-d3db7c1abb14 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:44.947296 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b160a981-90f0-4d1c-8bcb-d3db7c1abb14 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:44.992919 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-b160a981-90f0-4d1c-8bcb-d3db7c1abb14 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127544) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 12:52:45.313527 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-b160a981-90f0-4d1c-8bcb-d3db7c1abb14 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "POST /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/action" status: 202 len: 0 microversion: 2.20 time: 0.380448 Oct 03 12:52:45.314151 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 199/396] 10.222.0.33 () {62 vars in 1319 bytes} [Mon Oct 3 12:52:44 2022] POST /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:52:45.328014 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0137e1f4-4640-4160-8907-6ed2aa327713 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:45.329004 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-0137e1f4-4640-4160-8907-6ed2aa327713 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:45.348768 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0137e1f4-4640-4160-8907-6ed2aa327713 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:45.350108 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0137e1f4-4640-4160-8907-6ed2aa327713 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:45.350851 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0137e1f4-4640-4160-8907-6ed2aa327713 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:45.352438 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0137e1f4-4640-4160-8907-6ed2aa327713 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:45.352975 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0137e1f4-4640-4160-8907-6ed2aa327713 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:45.353647 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0137e1f4-4640-4160-8907-6ed2aa327713 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:45.381163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:45.544697 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0137e1f4-4640-4160-8907-6ed2aa327713 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:45.556155 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0137e1f4-4640-4160-8907-6ed2aa327713 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:45.558131 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0137e1f4-4640-4160-8907-6ed2aa327713 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:45.559564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-0137e1f4-4640-4160-8907-6ed2aa327713 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1751 microversion: 2.20 time: 0.240398 Oct 03 12:52:45.560681 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 198/397] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:45 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1751 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:45.638641 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-517a46e8-465a-477c-9880-ff81e1efa40e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:45.639262 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-517a46e8-465a-477c-9880-ff81e1efa40e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:45.648082 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-517a46e8-465a-477c-9880-ff81e1efa40e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:45.648858 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-517a46e8-465a-477c-9880-ff81e1efa40e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:45.649501 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-517a46e8-465a-477c-9880-ff81e1efa40e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:45.650747 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-517a46e8-465a-477c-9880-ff81e1efa40e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:45.656157 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-517a46e8-465a-477c-9880-ff81e1efa40e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:45.656157 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-517a46e8-465a-477c-9880-ff81e1efa40e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:45.823465 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-517a46e8-465a-477c-9880-ff81e1efa40e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:45.833647 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-517a46e8-465a-477c-9880-ff81e1efa40e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1277 microversion: 2.1 time: 0.198996 Oct 03 12:52:45.840431 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 200/398] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:45 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1277 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:46.595507 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-40c98f80-e5fa-4486-b44e-77fac8daa717 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:46.596138 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-40c98f80-e5fa-4486-b44e-77fac8daa717 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:46.605145 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40c98f80-e5fa-4486-b44e-77fac8daa717 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:46.605317 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40c98f80-e5fa-4486-b44e-77fac8daa717 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:46.605916 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40c98f80-e5fa-4486-b44e-77fac8daa717 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:46.606621 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40c98f80-e5fa-4486-b44e-77fac8daa717 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:46.607085 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40c98f80-e5fa-4486-b44e-77fac8daa717 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:46.607543 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40c98f80-e5fa-4486-b44e-77fac8daa717 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:46.669565 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-1d8c865d-ef33-4e06-8899-6b9867e1e83a req-a613ad60-325d-49ab-8011-8e35e95149a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47633cfc-a1d3-41c4-ab31-71cd28896c05", "tag": "e8531efb-6d29-4faf-9d0d-838641bb6d52"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:52:46.680443 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-1d8c865d-ef33-4e06-8899-6b9867e1e83a req-a613ad60-325d-49ab-8011-8e35e95149a0 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:46.686245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-1d8c865d-ef33-4e06-8899-6b9867e1e83a req-a613ad60-325d-49ab-8011-8e35e95149a0 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:46.686245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-1d8c865d-ef33-4e06-8899-6b9867e1e83a req-a613ad60-325d-49ab-8011-8e35e95149a0 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:46.693759 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-1d8c865d-ef33-4e06-8899-6b9867e1e83a req-a613ad60-325d-49ab-8011-8e35e95149a0 service nova] Creating event network-changed:e8531efb-6d29-4faf-9d0d-838641bb6d52 for instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 on hv-cinder-84456 Oct 03 12:52:46.698961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-1d8c865d-ef33-4e06-8899-6b9867e1e83a req-a613ad60-325d-49ab-8011-8e35e95149a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032922 Oct 03 12:52:46.700183 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 201/399] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:52:46.764232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-40c98f80-e5fa-4486-b44e-77fac8daa717 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:46.776653 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-40c98f80-e5fa-4486-b44e-77fac8daa717 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:46.776653 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-40c98f80-e5fa-4486-b44e-77fac8daa717 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:46.776653 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-40c98f80-e5fa-4486-b44e-77fac8daa717 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1751 microversion: 2.20 time: 0.185619 Oct 03 12:52:46.776944 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 199/400] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:46 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:52:46.865696 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-360d5ea2-99dd-4de7-a048-cc7079c37d4f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:46.866411 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-360d5ea2-99dd-4de7-a048-cc7079c37d4f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:46.873581 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-360d5ea2-99dd-4de7-a048-cc7079c37d4f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:46.874073 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-360d5ea2-99dd-4de7-a048-cc7079c37d4f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:46.874511 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-360d5ea2-99dd-4de7-a048-cc7079c37d4f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:46.875217 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-360d5ea2-99dd-4de7-a048-cc7079c37d4f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:46.876102 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-360d5ea2-99dd-4de7-a048-cc7079c37d4f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:46.876702 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-360d5ea2-99dd-4de7-a048-cc7079c37d4f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:47.051658 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-360d5ea2-99dd-4de7-a048-cc7079c37d4f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:47.062375 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-360d5ea2-99dd-4de7-a048-cc7079c37d4f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.202977 Oct 03 12:52:47.062960 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 202/401] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:46 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:47.803335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-65ac44a4-bef8-44a6-8759-43c8b7eb4072 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:47.804071 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-65ac44a4-bef8-44a6-8759-43c8b7eb4072 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:47.810541 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-65ac44a4-bef8-44a6-8759-43c8b7eb4072 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:47.811039 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-65ac44a4-bef8-44a6-8759-43c8b7eb4072 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:47.811503 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-65ac44a4-bef8-44a6-8759-43c8b7eb4072 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:47.812239 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-65ac44a4-bef8-44a6-8759-43c8b7eb4072 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:47.812695 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-65ac44a4-bef8-44a6-8759-43c8b7eb4072 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:47.813123 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-65ac44a4-bef8-44a6-8759-43c8b7eb4072 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:47.975490 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-65ac44a4-bef8-44a6-8759-43c8b7eb4072 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:47.980929 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-65ac44a4-bef8-44a6-8759-43c8b7eb4072 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:47.982395 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-65ac44a4-bef8-44a6-8759-43c8b7eb4072 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:47.985972 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-65ac44a4-bef8-44a6-8759-43c8b7eb4072 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1751 microversion: 2.20 time: 0.185481 Oct 03 12:52:47.985972 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 200/402] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:47 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:48.086783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e45527c4-d26c-4f02-b046-4203e3ffcc4e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:48.087626 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-e45527c4-d26c-4f02-b046-4203e3ffcc4e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:48.093903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e45527c4-d26c-4f02-b046-4203e3ffcc4e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:48.094406 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e45527c4-d26c-4f02-b046-4203e3ffcc4e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:48.094861 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e45527c4-d26c-4f02-b046-4203e3ffcc4e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:48.095690 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e45527c4-d26c-4f02-b046-4203e3ffcc4e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:48.096072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e45527c4-d26c-4f02-b046-4203e3ffcc4e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:48.096683 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e45527c4-d26c-4f02-b046-4203e3ffcc4e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:48.240702 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e45527c4-d26c-4f02-b046-4203e3ffcc4e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:48.248861 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e45527c4-d26c-4f02-b046-4203e3ffcc4e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.165919 Oct 03 12:52:48.250911 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 203/403] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:48 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:49.010691 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-65649b7b-b192-4a01-a779-4dbc20023436 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:49.011307 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-65649b7b-b192-4a01-a779-4dbc20023436 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:49.018136 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-65649b7b-b192-4a01-a779-4dbc20023436 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:49.018634 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-65649b7b-b192-4a01-a779-4dbc20023436 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:49.019099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-65649b7b-b192-4a01-a779-4dbc20023436 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:49.019840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-65649b7b-b192-4a01-a779-4dbc20023436 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:49.020294 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-65649b7b-b192-4a01-a779-4dbc20023436 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:49.020723 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-65649b7b-b192-4a01-a779-4dbc20023436 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:49.161731 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-65649b7b-b192-4a01-a779-4dbc20023436 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:49.170219 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-65649b7b-b192-4a01-a779-4dbc20023436 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:49.171674 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-65649b7b-b192-4a01-a779-4dbc20023436 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:49.172948 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-65649b7b-b192-4a01-a779-4dbc20023436 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1751 microversion: 2.20 time: 0.166380 Oct 03 12:52:49.173505 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 201/404] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:49 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:49.273112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-53b01073-6a61-40ca-9cf5-3a24969b97a7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:49.273983 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-53b01073-6a61-40ca-9cf5-3a24969b97a7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:49.280419 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-53b01073-6a61-40ca-9cf5-3a24969b97a7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:49.280976 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-53b01073-6a61-40ca-9cf5-3a24969b97a7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:49.281430 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-53b01073-6a61-40ca-9cf5-3a24969b97a7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:49.289269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-53b01073-6a61-40ca-9cf5-3a24969b97a7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:49.289269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-53b01073-6a61-40ca-9cf5-3a24969b97a7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:49.289269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-53b01073-6a61-40ca-9cf5-3a24969b97a7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:49.439572 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-53b01073-6a61-40ca-9cf5-3a24969b97a7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:49.448234 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-53b01073-6a61-40ca-9cf5-3a24969b97a7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.179661 Oct 03 12:52:49.448832 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 204/405] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:49 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:50.198684 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-59b9c2aa-b808-4011-8185-696d6aee0e1a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:50.199305 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-59b9c2aa-b808-4011-8185-696d6aee0e1a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:50.205737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-59b9c2aa-b808-4011-8185-696d6aee0e1a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:50.206227 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-59b9c2aa-b808-4011-8185-696d6aee0e1a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:50.207893 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-59b9c2aa-b808-4011-8185-696d6aee0e1a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:50.208678 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-59b9c2aa-b808-4011-8185-696d6aee0e1a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:50.209164 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-59b9c2aa-b808-4011-8185-696d6aee0e1a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:50.209610 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-59b9c2aa-b808-4011-8185-696d6aee0e1a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:50.353484 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-59b9c2aa-b808-4011-8185-696d6aee0e1a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:50.362159 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-59b9c2aa-b808-4011-8185-696d6aee0e1a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:50.364244 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-59b9c2aa-b808-4011-8185-696d6aee0e1a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:50.365408 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-59b9c2aa-b808-4011-8185-696d6aee0e1a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1751 microversion: 2.20 time: 0.170654 Oct 03 12:52:50.365960 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 202/406] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:50 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:50.469963 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ee89a299-f041-4344-b15f-cc9109a1a08c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:50.470630 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ee89a299-f041-4344-b15f-cc9109a1a08c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:50.472591 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=2 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:50.473344 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=6 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:50.478402 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ee89a299-f041-4344-b15f-cc9109a1a08c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:50.478978 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ee89a299-f041-4344-b15f-cc9109a1a08c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:50.480684 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ee89a299-f041-4344-b15f-cc9109a1a08c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:50.480684 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ee89a299-f041-4344-b15f-cc9109a1a08c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:50.480684 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ee89a299-f041-4344-b15f-cc9109a1a08c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:50.481032 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ee89a299-f041-4344-b15f-cc9109a1a08c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:50.645819 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-ee89a299-f041-4344-b15f-cc9109a1a08c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:50.653702 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ee89a299-f041-4344-b15f-cc9109a1a08c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.187528 Oct 03 12:52:50.654331 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 205/407] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:50 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:51.391914 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c167b9bf-9e40-4c40-bfea-3722dd27f3ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:51.392527 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c167b9bf-9e40-4c40-bfea-3722dd27f3ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:51.400098 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c167b9bf-9e40-4c40-bfea-3722dd27f3ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:51.400588 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c167b9bf-9e40-4c40-bfea-3722dd27f3ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:51.401022 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c167b9bf-9e40-4c40-bfea-3722dd27f3ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:51.401714 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c167b9bf-9e40-4c40-bfea-3722dd27f3ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:51.402170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c167b9bf-9e40-4c40-bfea-3722dd27f3ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:51.402593 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c167b9bf-9e40-4c40-bfea-3722dd27f3ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:51.555931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c167b9bf-9e40-4c40-bfea-3722dd27f3ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:51.564510 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c167b9bf-9e40-4c40-bfea-3722dd27f3ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:51.566614 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c167b9bf-9e40-4c40-bfea-3722dd27f3ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:51.567812 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c167b9bf-9e40-4c40-bfea-3722dd27f3ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1751 microversion: 2.20 time: 0.180441 Oct 03 12:52:51.568371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 203/408] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:51 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:51.678156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-37f228f4-e786-4cc8-a864-094f200d5892 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:51.678778 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-37f228f4-e786-4cc8-a864-094f200d5892 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:51.684741 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-37f228f4-e786-4cc8-a864-094f200d5892 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:51.685225 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-37f228f4-e786-4cc8-a864-094f200d5892 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:51.685662 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-37f228f4-e786-4cc8-a864-094f200d5892 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:51.686362 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-37f228f4-e786-4cc8-a864-094f200d5892 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:51.686818 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-37f228f4-e786-4cc8-a864-094f200d5892 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:51.687523 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-37f228f4-e786-4cc8-a864-094f200d5892 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:51.830919 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-37f228f4-e786-4cc8-a864-094f200d5892 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:51.838721 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-37f228f4-e786-4cc8-a864-094f200d5892 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.164677 Oct 03 12:52:51.839216 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 206/409] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:51 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:52.593385 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-defb298d-7ec3-4e20-8882-1e01db48678b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:52.593949 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-defb298d-7ec3-4e20-8882-1e01db48678b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:52.595868 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=4 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:52.601183 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-defb298d-7ec3-4e20-8882-1e01db48678b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:52.601672 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-defb298d-7ec3-4e20-8882-1e01db48678b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:52.602114 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-defb298d-7ec3-4e20-8882-1e01db48678b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:52.602808 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-defb298d-7ec3-4e20-8882-1e01db48678b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:52.603265 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-defb298d-7ec3-4e20-8882-1e01db48678b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:52.603728 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-defb298d-7ec3-4e20-8882-1e01db48678b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:52.738083 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-defb298d-7ec3-4e20-8882-1e01db48678b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:52.746790 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-defb298d-7ec3-4e20-8882-1e01db48678b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:52.748271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-defb298d-7ec3-4e20-8882-1e01db48678b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:52.749434 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-defb298d-7ec3-4e20-8882-1e01db48678b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1753 microversion: 2.20 time: 0.160148 Oct 03 12:52:52.750062 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 204/410] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:52 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:52.875085 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-7c487d27-7490-45f2-b40f-c10dbc371b06 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:52.883230 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-7c487d27-7490-45f2-b40f-c10dbc371b06 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:52.883230 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7c487d27-7490-45f2-b40f-c10dbc371b06 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:52.883230 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7c487d27-7490-45f2-b40f-c10dbc371b06 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:52.883230 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7c487d27-7490-45f2-b40f-c10dbc371b06 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:52.883693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7c487d27-7490-45f2-b40f-c10dbc371b06 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:52.884140 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7c487d27-7490-45f2-b40f-c10dbc371b06 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:52.884558 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7c487d27-7490-45f2-b40f-c10dbc371b06 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:53.015034 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7c487d27-7490-45f2-b40f-c10dbc371b06 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:53.042087 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-7c487d27-7490-45f2-b40f-c10dbc371b06 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.171866 Oct 03 12:52:53.042799 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 207/411] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:52 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:53.776086 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0bb9c617-a271-45fa-ab93-6f613440baa7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:53.776699 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-0bb9c617-a271-45fa-ab93-6f613440baa7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:53.783245 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0bb9c617-a271-45fa-ab93-6f613440baa7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:53.783772 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0bb9c617-a271-45fa-ab93-6f613440baa7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:53.784282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0bb9c617-a271-45fa-ab93-6f613440baa7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:53.784952 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0bb9c617-a271-45fa-ab93-6f613440baa7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:53.785408 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0bb9c617-a271-45fa-ab93-6f613440baa7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:53.785841 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0bb9c617-a271-45fa-ab93-6f613440baa7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:53.919207 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0bb9c617-a271-45fa-ab93-6f613440baa7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:53.928061 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0bb9c617-a271-45fa-ab93-6f613440baa7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:53.929503 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0bb9c617-a271-45fa-ab93-6f613440baa7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:53.930674 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-0bb9c617-a271-45fa-ab93-6f613440baa7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1753 microversion: 2.20 time: 0.158542 Oct 03 12:52:53.931271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 205/412] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:53 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:54.064832 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-1b97d72c-0386-4bf6-a589-5d0e83be84ef tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:54.065449 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-1b97d72c-0386-4bf6-a589-5d0e83be84ef tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:54.072254 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1b97d72c-0386-4bf6-a589-5d0e83be84ef tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:54.072733 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1b97d72c-0386-4bf6-a589-5d0e83be84ef tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:54.073163 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1b97d72c-0386-4bf6-a589-5d0e83be84ef tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:54.073854 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1b97d72c-0386-4bf6-a589-5d0e83be84ef tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:54.074299 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1b97d72c-0386-4bf6-a589-5d0e83be84ef tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:54.074719 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1b97d72c-0386-4bf6-a589-5d0e83be84ef tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:54.240362 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-1b97d72c-0386-4bf6-a589-5d0e83be84ef tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:54.251912 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-1b97d72c-0386-4bf6-a589-5d0e83be84ef tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.190807 Oct 03 12:52:54.252506 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 208/413] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:54 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:54.956945 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e53292f5-f227-419d-947c-fd3d0077f892 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:54.957872 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e53292f5-f227-419d-947c-fd3d0077f892 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:54.964230 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e53292f5-f227-419d-947c-fd3d0077f892 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:54.964752 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e53292f5-f227-419d-947c-fd3d0077f892 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:54.965196 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e53292f5-f227-419d-947c-fd3d0077f892 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:54.965906 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e53292f5-f227-419d-947c-fd3d0077f892 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:54.966392 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e53292f5-f227-419d-947c-fd3d0077f892 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:54.966975 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e53292f5-f227-419d-947c-fd3d0077f892 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:55.113330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e53292f5-f227-419d-947c-fd3d0077f892 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:55.122061 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e53292f5-f227-419d-947c-fd3d0077f892 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:55.123520 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e53292f5-f227-419d-947c-fd3d0077f892 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:55.124717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e53292f5-f227-419d-947c-fd3d0077f892 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.172347 Oct 03 12:52:55.125276 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 206/414] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:54 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:55.279788 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-20efed90-d13b-43cc-8b34-dfe29cb11ce2 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:55.282260 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-20efed90-d13b-43cc-8b34-dfe29cb11ce2 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:55.295565 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20efed90-d13b-43cc-8b34-dfe29cb11ce2 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:55.296100 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20efed90-d13b-43cc-8b34-dfe29cb11ce2 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:55.296730 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20efed90-d13b-43cc-8b34-dfe29cb11ce2 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:55.297456 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20efed90-d13b-43cc-8b34-dfe29cb11ce2 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:55.297893 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20efed90-d13b-43cc-8b34-dfe29cb11ce2 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:55.298316 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-20efed90-d13b-43cc-8b34-dfe29cb11ce2 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:55.442806 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-20efed90-d13b-43cc-8b34-dfe29cb11ce2 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:55.450814 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-20efed90-d13b-43cc-8b34-dfe29cb11ce2 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.178249 Oct 03 12:52:55.451976 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 209/415] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:55 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:56.150444 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-6d2b37a5-b042-497e-b901-74c27d2d3e46 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:56.151054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-6d2b37a5-b042-497e-b901-74c27d2d3e46 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:56.158333 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6d2b37a5-b042-497e-b901-74c27d2d3e46 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:56.158836 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6d2b37a5-b042-497e-b901-74c27d2d3e46 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:56.159475 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6d2b37a5-b042-497e-b901-74c27d2d3e46 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:56.160642 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6d2b37a5-b042-497e-b901-74c27d2d3e46 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:56.161091 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6d2b37a5-b042-497e-b901-74c27d2d3e46 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:56.161555 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6d2b37a5-b042-497e-b901-74c27d2d3e46 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:56.350360 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6d2b37a5-b042-497e-b901-74c27d2d3e46 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:56.362614 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6d2b37a5-b042-497e-b901-74c27d2d3e46 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:56.364863 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6d2b37a5-b042-497e-b901-74c27d2d3e46 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:56.366101 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-6d2b37a5-b042-497e-b901-74c27d2d3e46 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.219488 Oct 03 12:52:56.380077 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 207/416] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:56 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:56.476211 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2f945e09-5b67-48eb-af9d-8841fd04353f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:56.477944 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2f945e09-5b67-48eb-af9d-8841fd04353f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:56.485312 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f945e09-5b67-48eb-af9d-8841fd04353f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:56.485808 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f945e09-5b67-48eb-af9d-8841fd04353f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:56.486378 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f945e09-5b67-48eb-af9d-8841fd04353f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:56.487506 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f945e09-5b67-48eb-af9d-8841fd04353f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:56.487968 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f945e09-5b67-48eb-af9d-8841fd04353f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:56.488521 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2f945e09-5b67-48eb-af9d-8841fd04353f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:56.717043 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2f945e09-5b67-48eb-af9d-8841fd04353f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:56.738319 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-2f945e09-5b67-48eb-af9d-8841fd04353f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.264743 Oct 03 12:52:56.739790 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 210/417] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:56 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:57.398227 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-83d8cd9e-34ad-4354-b526-99d52c56ddff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:57.399264 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-83d8cd9e-34ad-4354-b526-99d52c56ddff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:57.411511 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-83d8cd9e-34ad-4354-b526-99d52c56ddff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:57.412330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-83d8cd9e-34ad-4354-b526-99d52c56ddff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:57.413325 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-83d8cd9e-34ad-4354-b526-99d52c56ddff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:57.427990 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-83d8cd9e-34ad-4354-b526-99d52c56ddff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:57.429126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-83d8cd9e-34ad-4354-b526-99d52c56ddff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:57.429902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-83d8cd9e-34ad-4354-b526-99d52c56ddff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:57.641147 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-83d8cd9e-34ad-4354-b526-99d52c56ddff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:57.660818 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-83d8cd9e-34ad-4354-b526-99d52c56ddff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:57.667287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-83d8cd9e-34ad-4354-b526-99d52c56ddff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:57.670355 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-83d8cd9e-34ad-4354-b526-99d52c56ddff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.282479 Oct 03 12:52:57.671067 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 208/418] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:57 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:52:57.765838 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-36ddc300-0b3a-42bf-a869-db0cf619fc1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:57.767884 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-36ddc300-0b3a-42bf-a869-db0cf619fc1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:57.774496 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36ddc300-0b3a-42bf-a869-db0cf619fc1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:57.775212 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36ddc300-0b3a-42bf-a869-db0cf619fc1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:57.776008 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36ddc300-0b3a-42bf-a869-db0cf619fc1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:57.776904 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36ddc300-0b3a-42bf-a869-db0cf619fc1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:57.777691 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36ddc300-0b3a-42bf-a869-db0cf619fc1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:57.778277 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36ddc300-0b3a-42bf-a869-db0cf619fc1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:57.968617 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-36ddc300-0b3a-42bf-a869-db0cf619fc1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:57.980669 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-36ddc300-0b3a-42bf-a869-db0cf619fc1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.219394 Oct 03 12:52:57.995727 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 211/419] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:57 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:52:58.700439 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c5282f43-9574-4298-baaa-fd1081eaf0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:58.701068 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c5282f43-9574-4298-baaa-fd1081eaf0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:58.715372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5282f43-9574-4298-baaa-fd1081eaf0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:58.715985 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5282f43-9574-4298-baaa-fd1081eaf0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:58.716443 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5282f43-9574-4298-baaa-fd1081eaf0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:58.717192 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5282f43-9574-4298-baaa-fd1081eaf0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:58.717669 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5282f43-9574-4298-baaa-fd1081eaf0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:58.720949 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5282f43-9574-4298-baaa-fd1081eaf0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:59.004509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c5282f43-9574-4298-baaa-fd1081eaf0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:59.015103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-107128cc-8bea-4788-9c22-1a31bd525818 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:52:59.016785 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-107128cc-8bea-4788-9c22-1a31bd525818 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:52:59.033074 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-107128cc-8bea-4788-9c22-1a31bd525818 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:59.033074 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-107128cc-8bea-4788-9c22-1a31bd525818 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:59.033074 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-107128cc-8bea-4788-9c22-1a31bd525818 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:59.033074 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-107128cc-8bea-4788-9c22-1a31bd525818 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:59.033430 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-107128cc-8bea-4788-9c22-1a31bd525818 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:59.033430 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-107128cc-8bea-4788-9c22-1a31bd525818 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:59.033576 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c5282f43-9574-4298-baaa-fd1081eaf0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:59.044670 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c5282f43-9574-4298-baaa-fd1081eaf0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:59.049324 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c5282f43-9574-4298-baaa-fd1081eaf0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.351995 Oct 03 12:52:59.065181 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 209/420] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:52:58 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:52:59.293298 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-107128cc-8bea-4788-9c22-1a31bd525818 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:52:59.302766 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-92587a54-d0f5-41f8-a615-0d7196928042 req-8e45217b-9e6f-418a-8b22-514b3a61e046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47633cfc-a1d3-41c4-ab31-71cd28896c05", "name": "network-vif-plugged", "status": "completed", "tag": "e8531efb-6d29-4faf-9d0d-838641bb6d52"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:52:59.309608 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-107128cc-8bea-4788-9c22-1a31bd525818 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.307467 Oct 03 12:52:59.310194 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 212/421] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:52:59 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:52:59.325417 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-92587a54-d0f5-41f8-a615-0d7196928042 req-8e45217b-9e6f-418a-8b22-514b3a61e046 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:52:59.326050 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-92587a54-d0f5-41f8-a615-0d7196928042 req-8e45217b-9e6f-418a-8b22-514b3a61e046 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:52:59.326850 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-92587a54-d0f5-41f8-a615-0d7196928042 req-8e45217b-9e6f-418a-8b22-514b3a61e046 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:52:59.361801 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-92587a54-d0f5-41f8-a615-0d7196928042 req-8e45217b-9e6f-418a-8b22-514b3a61e046 service nova] Creating event network-vif-plugged:e8531efb-6d29-4faf-9d0d-838641bb6d52 for instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 on hv-cinder-84456 Oct 03 12:52:59.371159 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-92587a54-d0f5-41f8-a615-0d7196928042 req-8e45217b-9e6f-418a-8b22-514b3a61e046 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072512 Oct 03 12:52:59.372888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 210/422] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:53:00.078424 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9f6e1518-6ce4-48f7-8a6b-299fe9ebe2b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:00.079051 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-9f6e1518-6ce4-48f7-8a6b-299fe9ebe2b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:00.094337 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9f6e1518-6ce4-48f7-8a6b-299fe9ebe2b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:00.095049 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9f6e1518-6ce4-48f7-8a6b-299fe9ebe2b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:00.095680 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9f6e1518-6ce4-48f7-8a6b-299fe9ebe2b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:00.097230 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9f6e1518-6ce4-48f7-8a6b-299fe9ebe2b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:00.097866 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9f6e1518-6ce4-48f7-8a6b-299fe9ebe2b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:00.102884 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9f6e1518-6ce4-48f7-8a6b-299fe9ebe2b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:00.140721 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:00.281336 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9f6e1518-6ce4-48f7-8a6b-299fe9ebe2b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:00.292332 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9f6e1518-6ce4-48f7-8a6b-299fe9ebe2b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:00.304220 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9f6e1518-6ce4-48f7-8a6b-299fe9ebe2b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:00.305707 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-9f6e1518-6ce4-48f7-8a6b-299fe9ebe2b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.231197 Oct 03 12:53:00.306880 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 213/423] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:00 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:00.338315 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3b17f196-d745-4523-b950-23298eea1f88 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:00.339026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3b17f196-d745-4523-b950-23298eea1f88 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:00.346404 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3b17f196-d745-4523-b950-23298eea1f88 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:00.347990 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3b17f196-d745-4523-b950-23298eea1f88 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:00.348806 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3b17f196-d745-4523-b950-23298eea1f88 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:00.349730 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3b17f196-d745-4523-b950-23298eea1f88 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:00.350534 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3b17f196-d745-4523-b950-23298eea1f88 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:00.351203 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3b17f196-d745-4523-b950-23298eea1f88 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:00.543257 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3b17f196-d745-4523-b950-23298eea1f88 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:00.561659 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3b17f196-d745-4523-b950-23298eea1f88 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.231162 Oct 03 12:53:00.562762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 211/424] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:00 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:01.335434 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-5c640015-6d63-4004-9a0d-09a3b0a919a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:01.340921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-5c640015-6d63-4004-9a0d-09a3b0a919a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:01.348657 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c640015-6d63-4004-9a0d-09a3b0a919a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:01.349542 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c640015-6d63-4004-9a0d-09a3b0a919a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:01.350277 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c640015-6d63-4004-9a0d-09a3b0a919a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:01.351360 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c640015-6d63-4004-9a0d-09a3b0a919a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:01.352034 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c640015-6d63-4004-9a0d-09a3b0a919a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:01.352836 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c640015-6d63-4004-9a0d-09a3b0a919a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:01.586529 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-99b13a41-b206-40bd-8720-b0192228745e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:01.588473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-99b13a41-b206-40bd-8720-b0192228745e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:01.603717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99b13a41-b206-40bd-8720-b0192228745e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:01.609727 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99b13a41-b206-40bd-8720-b0192228745e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:01.613898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99b13a41-b206-40bd-8720-b0192228745e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:01.613898 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99b13a41-b206-40bd-8720-b0192228745e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:01.616248 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99b13a41-b206-40bd-8720-b0192228745e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:01.617861 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-99b13a41-b206-40bd-8720-b0192228745e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:01.907306 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5c640015-6d63-4004-9a0d-09a3b0a919a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:01.926609 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5c640015-6d63-4004-9a0d-09a3b0a919a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:01.929256 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5c640015-6d63-4004-9a0d-09a3b0a919a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:01.936837 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-5c640015-6d63-4004-9a0d-09a3b0a919a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.603482 Oct 03 12:53:01.938002 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 214/425] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:01 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:02.070891 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-99b13a41-b206-40bd-8720-b0192228745e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:02.080539 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-99b13a41-b206-40bd-8720-b0192228745e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.498865 Oct 03 12:53:02.085926 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 212/426] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:01 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:53:02.974899 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-28707ab4-8bdc-49ef-848c-71de37cd6e35 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:02.974899 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-28707ab4-8bdc-49ef-848c-71de37cd6e35 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:02.980418 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-28707ab4-8bdc-49ef-848c-71de37cd6e35 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:02.980909 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-28707ab4-8bdc-49ef-848c-71de37cd6e35 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:02.981367 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-28707ab4-8bdc-49ef-848c-71de37cd6e35 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:02.982063 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-28707ab4-8bdc-49ef-848c-71de37cd6e35 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:02.982668 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-28707ab4-8bdc-49ef-848c-71de37cd6e35 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:02.983094 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-28707ab4-8bdc-49ef-848c-71de37cd6e35 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:03.113403 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8759a8f8-2eae-409b-9638-ed42ee8fc1f9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:03.114723 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8759a8f8-2eae-409b-9638-ed42ee8fc1f9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:03.122968 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8759a8f8-2eae-409b-9638-ed42ee8fc1f9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:03.124137 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8759a8f8-2eae-409b-9638-ed42ee8fc1f9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:03.124774 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8759a8f8-2eae-409b-9638-ed42ee8fc1f9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:03.125826 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8759a8f8-2eae-409b-9638-ed42ee8fc1f9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:03.126507 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8759a8f8-2eae-409b-9638-ed42ee8fc1f9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:03.127112 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8759a8f8-2eae-409b-9638-ed42ee8fc1f9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:03.713416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-28707ab4-8bdc-49ef-848c-71de37cd6e35 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:03.741002 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-28707ab4-8bdc-49ef-848c-71de37cd6e35 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:03.747950 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-28707ab4-8bdc-49ef-848c-71de37cd6e35 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:03.754711 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8759a8f8-2eae-409b-9638-ed42ee8fc1f9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:03.760186 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-28707ab4-8bdc-49ef-848c-71de37cd6e35 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.792393 Oct 03 12:53:03.762831 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 215/427] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:02 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:03.791408 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8759a8f8-2eae-409b-9638-ed42ee8fc1f9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.682565 Oct 03 12:53:03.792034 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 213/428] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:03 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:04.834903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c55580a2-1a3b-42fe-b924-36fbad4440a9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:04.834903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-c55580a2-1a3b-42fe-b924-36fbad4440a9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:04.834903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c55580a2-1a3b-42fe-b924-36fbad4440a9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:04.834903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c55580a2-1a3b-42fe-b924-36fbad4440a9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:04.836184 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c55580a2-1a3b-42fe-b924-36fbad4440a9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:04.836184 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c55580a2-1a3b-42fe-b924-36fbad4440a9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:04.836184 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c55580a2-1a3b-42fe-b924-36fbad4440a9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:04.836184 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c55580a2-1a3b-42fe-b924-36fbad4440a9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:04.836507 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-6bb4b4cd-99b2-4c66-9b5a-e74174833264 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:04.836507 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-6bb4b4cd-99b2-4c66-9b5a-e74174833264 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:04.836507 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6bb4b4cd-99b2-4c66-9b5a-e74174833264 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:04.836507 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6bb4b4cd-99b2-4c66-9b5a-e74174833264 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:04.837153 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6bb4b4cd-99b2-4c66-9b5a-e74174833264 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:04.837153 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6bb4b4cd-99b2-4c66-9b5a-e74174833264 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:04.837153 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6bb4b4cd-99b2-4c66-9b5a-e74174833264 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:04.837153 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6bb4b4cd-99b2-4c66-9b5a-e74174833264 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:05.154626 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c55580a2-1a3b-42fe-b924-36fbad4440a9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:05.186672 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c55580a2-1a3b-42fe-b924-36fbad4440a9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:05.193322 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c55580a2-1a3b-42fe-b924-36fbad4440a9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:05.194552 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c55580a2-1a3b-42fe-b924-36fbad4440a9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.400309 Oct 03 12:53:05.201289 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 216/429] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:04 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:05.225298 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6bb4b4cd-99b2-4c66-9b5a-e74174833264 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:05.254847 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-6bb4b4cd-99b2-4c66-9b5a-e74174833264 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.439369 Oct 03 12:53:05.260102 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 214/430] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:04 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:53:06.223572 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-17f5a313-e160-4f7f-910c-7b587d4ce939 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:06.225065 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-17f5a313-e160-4f7f-910c-7b587d4ce939 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:06.231762 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-17f5a313-e160-4f7f-910c-7b587d4ce939 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:06.234140 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-17f5a313-e160-4f7f-910c-7b587d4ce939 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:06.234140 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-17f5a313-e160-4f7f-910c-7b587d4ce939 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:06.234140 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-17f5a313-e160-4f7f-910c-7b587d4ce939 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:06.234140 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-17f5a313-e160-4f7f-910c-7b587d4ce939 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:06.234708 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-17f5a313-e160-4f7f-910c-7b587d4ce939 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:06.288418 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-9ea82690-e44e-432e-bae7-e542be2d77b7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:06.289200 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-9ea82690-e44e-432e-bae7-e542be2d77b7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:06.302551 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9ea82690-e44e-432e-bae7-e542be2d77b7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:06.307187 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9ea82690-e44e-432e-bae7-e542be2d77b7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:06.307895 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9ea82690-e44e-432e-bae7-e542be2d77b7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:06.308670 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9ea82690-e44e-432e-bae7-e542be2d77b7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:06.309315 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9ea82690-e44e-432e-bae7-e542be2d77b7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:06.309912 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9ea82690-e44e-432e-bae7-e542be2d77b7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:06.444012 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-17f5a313-e160-4f7f-910c-7b587d4ce939 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:06.458360 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-17f5a313-e160-4f7f-910c-7b587d4ce939 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:06.461290 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-17f5a313-e160-4f7f-910c-7b587d4ce939 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:06.462653 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-17f5a313-e160-4f7f-910c-7b587d4ce939 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.244174 Oct 03 12:53:06.482720 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 217/431] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:06 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:06.496158 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-9ea82690-e44e-432e-bae7-e542be2d77b7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:06.501280 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=100 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:06.507369 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-9ea82690-e44e-432e-bae7-e542be2d77b7 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.223694 Oct 03 12:53:06.507978 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 215/432] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:06 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:53:07.495582 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e1c17f09-49c9-41d2-8380-6d49f132077f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:07.496479 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-e1c17f09-49c9-41d2-8380-6d49f132077f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:07.519448 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e1c17f09-49c9-41d2-8380-6d49f132077f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:07.519448 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e1c17f09-49c9-41d2-8380-6d49f132077f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:07.519448 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e1c17f09-49c9-41d2-8380-6d49f132077f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:07.519448 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e1c17f09-49c9-41d2-8380-6d49f132077f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:07.519875 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e1c17f09-49c9-41d2-8380-6d49f132077f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:07.519875 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e1c17f09-49c9-41d2-8380-6d49f132077f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:07.535980 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-56ed12d8-cfd2-42ec-b233-f569a88a9e44 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:07.542772 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-56ed12d8-cfd2-42ec-b233-f569a88a9e44 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:07.545281 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-56ed12d8-cfd2-42ec-b233-f569a88a9e44 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:07.545775 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-56ed12d8-cfd2-42ec-b233-f569a88a9e44 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:07.546213 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-56ed12d8-cfd2-42ec-b233-f569a88a9e44 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:07.546921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-56ed12d8-cfd2-42ec-b233-f569a88a9e44 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:07.547405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-56ed12d8-cfd2-42ec-b233-f569a88a9e44 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:07.547942 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-56ed12d8-cfd2-42ec-b233-f569a88a9e44 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:07.729170 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e1c17f09-49c9-41d2-8380-6d49f132077f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:07.738207 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-56ed12d8-cfd2-42ec-b233-f569a88a9e44 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:07.746704 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-56ed12d8-cfd2-42ec-b233-f569a88a9e44 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.215146 Oct 03 12:53:07.748944 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 216/433] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:07 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:53:07.749648 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e1c17f09-49c9-41d2-8380-6d49f132077f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:07.751140 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e1c17f09-49c9-41d2-8380-6d49f132077f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:07.752338 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e1c17f09-49c9-41d2-8380-6d49f132077f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.268136 Oct 03 12:53:07.753607 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 218/434] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:07 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:08.771972 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8c71b850-bf59-452f-93c8-1e146d20cc8e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:08.773728 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8c71b850-bf59-452f-93c8-1e146d20cc8e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:08.779732 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-747c4450-142f-41e3-b5ce-d3a22b486875 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:08.781358 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-747c4450-142f-41e3-b5ce-d3a22b486875 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:08.781538 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c71b850-bf59-452f-93c8-1e146d20cc8e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:08.782174 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c71b850-bf59-452f-93c8-1e146d20cc8e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:08.782763 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c71b850-bf59-452f-93c8-1e146d20cc8e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:08.783821 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c71b850-bf59-452f-93c8-1e146d20cc8e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:08.784958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c71b850-bf59-452f-93c8-1e146d20cc8e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:08.786027 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c71b850-bf59-452f-93c8-1e146d20cc8e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:08.794610 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-747c4450-142f-41e3-b5ce-d3a22b486875 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:08.794610 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-747c4450-142f-41e3-b5ce-d3a22b486875 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:08.794610 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-747c4450-142f-41e3-b5ce-d3a22b486875 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:08.794610 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-747c4450-142f-41e3-b5ce-d3a22b486875 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:08.794981 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-747c4450-142f-41e3-b5ce-d3a22b486875 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:08.794981 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-747c4450-142f-41e3-b5ce-d3a22b486875 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:09.073062 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8c71b850-bf59-452f-93c8-1e146d20cc8e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:09.083939 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-747c4450-142f-41e3-b5ce-d3a22b486875 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:09.092547 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8c71b850-bf59-452f-93c8-1e146d20cc8e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.326522 Oct 03 12:53:09.093194 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 217/435] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:08 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:09.097391 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-747c4450-142f-41e3-b5ce-d3a22b486875 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:09.102451 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-747c4450-142f-41e3-b5ce-d3a22b486875 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:09.104407 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-747c4450-142f-41e3-b5ce-d3a22b486875 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.328696 Oct 03 12:53:09.106880 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 219/436] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:08 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:10.126109 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-661b9549-3c25-481b-a6c9-027a93740f37 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:10.126109 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-661b9549-3c25-481b-a6c9-027a93740f37 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:10.126109 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661b9549-3c25-481b-a6c9-027a93740f37 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:10.126109 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661b9549-3c25-481b-a6c9-027a93740f37 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:10.127723 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661b9549-3c25-481b-a6c9-027a93740f37 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:10.127723 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661b9549-3c25-481b-a6c9-027a93740f37 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:10.127966 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661b9549-3c25-481b-a6c9-027a93740f37 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:10.128648 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661b9549-3c25-481b-a6c9-027a93740f37 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:10.132219 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-6b286540-6e45-47ca-9287-91559122f563 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:10.132827 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-6b286540-6e45-47ca-9287-91559122f563 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:10.149021 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6b286540-6e45-47ca-9287-91559122f563 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:10.149866 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6b286540-6e45-47ca-9287-91559122f563 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:10.150387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6b286540-6e45-47ca-9287-91559122f563 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:10.151136 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6b286540-6e45-47ca-9287-91559122f563 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:10.151712 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6b286540-6e45-47ca-9287-91559122f563 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:10.157585 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6b286540-6e45-47ca-9287-91559122f563 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:10.388848 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-661b9549-3c25-481b-a6c9-027a93740f37 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:10.396951 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-661b9549-3c25-481b-a6c9-027a93740f37 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.285183 Oct 03 12:53:10.398045 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 218/437] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:10 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:10.422543 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-6b286540-6e45-47ca-9287-91559122f563 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:10.432547 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-6b286540-6e45-47ca-9287-91559122f563 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:10.434395 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-6b286540-6e45-47ca-9287-91559122f563 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:10.435663 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-6b286540-6e45-47ca-9287-91559122f563 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.307559 Oct 03 12:53:10.436417 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 220/438] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:10 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:11.427727 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-013b46a3-c112-4ea8-8342-26ebb0151ce4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:11.428386 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-013b46a3-c112-4ea8-8342-26ebb0151ce4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:11.440774 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-013b46a3-c112-4ea8-8342-26ebb0151ce4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:11.448128 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-013b46a3-c112-4ea8-8342-26ebb0151ce4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:11.448587 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-013b46a3-c112-4ea8-8342-26ebb0151ce4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:11.449472 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-013b46a3-c112-4ea8-8342-26ebb0151ce4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:11.449925 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-013b46a3-c112-4ea8-8342-26ebb0151ce4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:11.450360 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-013b46a3-c112-4ea8-8342-26ebb0151ce4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:11.466265 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8f9e0b05-112e-4023-9173-23d93680fee2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:11.468706 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8f9e0b05-112e-4023-9173-23d93680fee2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:11.483825 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f9e0b05-112e-4023-9173-23d93680fee2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:11.485349 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f9e0b05-112e-4023-9173-23d93680fee2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:11.486012 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f9e0b05-112e-4023-9173-23d93680fee2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:11.488672 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f9e0b05-112e-4023-9173-23d93680fee2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:11.490139 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f9e0b05-112e-4023-9173-23d93680fee2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:11.491771 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f9e0b05-112e-4023-9173-23d93680fee2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:11.701214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-013b46a3-c112-4ea8-8342-26ebb0151ce4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:11.710877 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-013b46a3-c112-4ea8-8342-26ebb0151ce4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1265 microversion: 2.1 time: 0.290177 Oct 03 12:53:11.711382 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8f9e0b05-112e-4023-9173-23d93680fee2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:11.712043 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 219/439] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:11 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1265 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:11.736056 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8f9e0b05-112e-4023-9173-23d93680fee2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:11.743208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8f9e0b05-112e-4023-9173-23d93680fee2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:11.750182 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-8f9e0b05-112e-4023-9173-23d93680fee2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.286217 Oct 03 12:53:11.754645 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 221/440] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:11 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:11.756756 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-38aa3bc6-5cba-4733-a2f8-a05e8bb20374 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:11.757541 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-38aa3bc6-5cba-4733-a2f8-a05e8bb20374 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:11.774581 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38aa3bc6-5cba-4733-a2f8-a05e8bb20374 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:11.775750 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38aa3bc6-5cba-4733-a2f8-a05e8bb20374 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:11.776657 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38aa3bc6-5cba-4733-a2f8-a05e8bb20374 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:11.777490 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38aa3bc6-5cba-4733-a2f8-a05e8bb20374 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:11.778057 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38aa3bc6-5cba-4733-a2f8-a05e8bb20374 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:11.778593 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38aa3bc6-5cba-4733-a2f8-a05e8bb20374 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:11.921402 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-38aa3bc6-5cba-4733-a2f8-a05e8bb20374 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lazy-loading 'services' on Instance uuid a980d091-a942-46bc-a139-d12f9e2167ed {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:53:11.932917 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-f286ab77-6409-4d45-90a4-4155891d08b3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04dc6a57-1ed6-4c6e-a423-b0ad9c899e11"}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:53:11.936118 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-f286ab77-6409-4d45-90a4-4155891d08b3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:11.948584 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f286ab77-6409-4d45-90a4-4155891d08b3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:11.951582 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f286ab77-6409-4d45-90a4-4155891d08b3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:11.954791 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f286ab77-6409-4d45-90a4-4155891d08b3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:11.956198 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f286ab77-6409-4d45-90a4-4155891d08b3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:11.960130 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f286ab77-6409-4d45-90a4-4155891d08b3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:11.961866 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f286ab77-6409-4d45-90a4-4155891d08b3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:12.309631 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-38aa3bc6-5cba-4733-a2f8-a05e8bb20374 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/os-volume_attachments/77bbfa5a-01a9-426f-9286-b06e95f2b9ec" status: 202 len: 0 microversion: 2.1 time: 0.559727 Oct 03 12:53:12.311114 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 220/441] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 12:53:11 2022] DELETE /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/os-volume_attachments/77bbfa5a-01a9-426f-9286-b06e95f2b9ec => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:53:12.839873 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-dcf5cb56-34b0-4362-9a1e-147ffcc4c00c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Action: 'create', calling method: .version_select at 0x7fc74025e3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2145702352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9lOSlc9nGdO9TYbCTnsr0M3X6hrym0ApfAOW7kSFQKwTFrzjLMu/lwvE9/iVHl/wYpolZUHf6FpKizOizixAPOr59u/Md+XwFs/WZShIshbfRwk8kNrhAWltMRhfo7TQ=="}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:53:12.855909 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-dcf5cb56-34b0-4362-9a1e-147ffcc4c00c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Getting quotas for project 06a284bf10ff47d6bc58de80f92c164a. Resources: {'key_pairs'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:53:12.860189 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-dcf5cb56-34b0-4362-9a1e-147ffcc4c00c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Getting quotas for user bafb4a06c49d47cdb970e3f9e08a2543 and project 06a284bf10ff47d6bc58de80f92c164a. Resources: {'key_pairs'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:53:12.864817 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-f286ab77-6409-4d45-90a4-4155891d08b3 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "POST /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.937007 Oct 03 12:53:12.871520 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 222/442] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 12:53:11 2022] POST /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-volume_attachments => generated 194 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:53:12.871520 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ea73ace3-5056-41f7-97d2-a7b3d441084d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:12.871996 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ea73ace3-5056-41f7-97d2-a7b3d441084d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:12.884675 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ea73ace3-5056-41f7-97d2-a7b3d441084d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:12.885173 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ea73ace3-5056-41f7-97d2-a7b3d441084d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:12.885823 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ea73ace3-5056-41f7-97d2-a7b3d441084d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:12.889670 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ea73ace3-5056-41f7-97d2-a7b3d441084d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:12.890313 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ea73ace3-5056-41f7-97d2-a7b3d441084d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:12.890912 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ea73ace3-5056-41f7-97d2-a7b3d441084d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:13.058029 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-dcf5cb56-34b0-4362-9a1e-147ffcc4c00c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.452607 Oct 03 12:53:13.062238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 221/443] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 12:53:12 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:53:13.072560 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f3597462-5167-4c0d-9536-44a9ed487f1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:13.077152 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f3597462-5167-4c0d-9536-44a9ed487f1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:13.125750 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3597462-5167-4c0d-9536-44a9ed487f1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:13.169330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3597462-5167-4c0d-9536-44a9ed487f1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:13.169330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3597462-5167-4c0d-9536-44a9ed487f1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:13.169330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3597462-5167-4c0d-9536-44a9ed487f1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:13.169330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3597462-5167-4c0d-9536-44a9ed487f1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:13.171212 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3597462-5167-4c0d-9536-44a9ed487f1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:13.171569 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-ea73ace3-5056-41f7-97d2-a7b3d441084d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:13.179619 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ea73ace3-5056-41f7-97d2-a7b3d441084d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1451 microversion: 2.1 time: 0.312351 Oct 03 12:53:13.197936 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 223/444] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:12 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1451 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:13.216775 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8fd924f1-ba48-42da-a737-281a088972d8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:13.218298 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8fd924f1-ba48-42da-a737-281a088972d8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:13.225436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8fd924f1-ba48-42da-a737-281a088972d8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:13.225938 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8fd924f1-ba48-42da-a737-281a088972d8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:13.226381 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8fd924f1-ba48-42da-a737-281a088972d8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:13.227131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8fd924f1-ba48-42da-a737-281a088972d8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:13.227613 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8fd924f1-ba48-42da-a737-281a088972d8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:13.228248 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8fd924f1-ba48-42da-a737-281a088972d8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:13.417187 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-f3597462-5167-4c0d-9536-44a9ed487f1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:13.445137 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-f3597462-5167-4c0d-9536-44a9ed487f1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:13.449804 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-f3597462-5167-4c0d-9536-44a9ed487f1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:13.452477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f3597462-5167-4c0d-9536-44a9ed487f1e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.389060 Oct 03 12:53:13.460916 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 222/445] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:13 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:13.468905 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8fd924f1-ba48-42da-a737-281a088972d8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:13.478208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-8fd924f1-ba48-42da-a737-281a088972d8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1451 microversion: 2.1 time: 0.265589 Oct 03 12:53:13.480743 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 224/446] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:13 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1451 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:13.534268 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0763a31a-1e88-4473-a71f-144c93151ec2 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:53:13.540284 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:13.541764 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0763a31a-1e88-4473-a71f-144c93151ec2 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:13.542264 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0763a31a-1e88-4473-a71f-144c93151ec2 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:13.542703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0763a31a-1e88-4473-a71f-144c93151ec2 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:13.595146 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-0763a31a-1e88-4473-a71f-144c93151ec2 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Going to try to stop instance {{(pid=127542) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 12:53:13.864949 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-0763a31a-1e88-4473-a71f-144c93151ec2 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "POST /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/action" status: 202 len: 0 microversion: 2.1 time: 0.336755 Oct 03 12:53:13.865849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 223/447] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 12:53:13 2022] POST /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:53:13.874057 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d0b88e28-59a2-41ae-8637-8baf21694c90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:13.875222 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d0b88e28-59a2-41ae-8637-8baf21694c90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:13.881390 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d0b88e28-59a2-41ae-8637-8baf21694c90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:13.881872 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d0b88e28-59a2-41ae-8637-8baf21694c90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:13.882305 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d0b88e28-59a2-41ae-8637-8baf21694c90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:13.882993 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d0b88e28-59a2-41ae-8637-8baf21694c90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:13.883469 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d0b88e28-59a2-41ae-8637-8baf21694c90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:13.883890 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d0b88e28-59a2-41ae-8637-8baf21694c90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:14.045801 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d0b88e28-59a2-41ae-8637-8baf21694c90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:14.084145 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d0b88e28-59a2-41ae-8637-8baf21694c90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1677 microversion: 2.1 time: 0.213358 Oct 03 12:53:14.086044 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 225/448] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:13 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:14.483509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-00ee638f-e36c-4d7c-a050-edf6e34507a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:14.484261 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-00ee638f-e36c-4d7c-a050-edf6e34507a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:14.496536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-00ee638f-e36c-4d7c-a050-edf6e34507a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:14.497032 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-00ee638f-e36c-4d7c-a050-edf6e34507a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:14.497977 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-00ee638f-e36c-4d7c-a050-edf6e34507a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:14.499087 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-00ee638f-e36c-4d7c-a050-edf6e34507a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:14.499761 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-00ee638f-e36c-4d7c-a050-edf6e34507a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:14.500422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-00ee638f-e36c-4d7c-a050-edf6e34507a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:14.644190 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-00ee638f-e36c-4d7c-a050-edf6e34507a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:14.655582 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-00ee638f-e36c-4d7c-a050-edf6e34507a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:14.658339 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-00ee638f-e36c-4d7c-a050-edf6e34507a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:14.662434 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-00ee638f-e36c-4d7c-a050-edf6e34507a5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.183482 Oct 03 12:53:14.663204 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 224/449] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:14 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:15.116834 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bd49323a-d934-4445-a1ac-133e89d15f90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:15.118122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-bd49323a-d934-4445-a1ac-133e89d15f90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:15.130416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:15.133383 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bd49323a-d934-4445-a1ac-133e89d15f90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:15.133926 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bd49323a-d934-4445-a1ac-133e89d15f90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:15.134364 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bd49323a-d934-4445-a1ac-133e89d15f90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:15.135126 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bd49323a-d934-4445-a1ac-133e89d15f90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:15.135619 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bd49323a-d934-4445-a1ac-133e89d15f90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:15.136240 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bd49323a-d934-4445-a1ac-133e89d15f90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:15.337223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-bd49323a-d934-4445-a1ac-133e89d15f90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:15.350273 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-bd49323a-d934-4445-a1ac-133e89d15f90 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1677 microversion: 2.1 time: 0.233011 Oct 03 12:53:15.355354 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 226/450] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:15 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1677 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:15.694993 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0b4cf9fa-716e-46d8-a0ae-6961b3fbaa43 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:15.705392 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-0b4cf9fa-716e-46d8-a0ae-6961b3fbaa43 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:15.705392 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0b4cf9fa-716e-46d8-a0ae-6961b3fbaa43 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:15.705392 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0b4cf9fa-716e-46d8-a0ae-6961b3fbaa43 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:15.705392 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0b4cf9fa-716e-46d8-a0ae-6961b3fbaa43 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:15.706589 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0b4cf9fa-716e-46d8-a0ae-6961b3fbaa43 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:15.706589 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0b4cf9fa-716e-46d8-a0ae-6961b3fbaa43 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:15.706589 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0b4cf9fa-716e-46d8-a0ae-6961b3fbaa43 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:15.854877 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0b4cf9fa-716e-46d8-a0ae-6961b3fbaa43 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:15.864292 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0b4cf9fa-716e-46d8-a0ae-6961b3fbaa43 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:15.866671 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0b4cf9fa-716e-46d8-a0ae-6961b3fbaa43 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:15.868190 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-0b4cf9fa-716e-46d8-a0ae-6961b3fbaa43 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.177973 Oct 03 12:53:15.869013 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 225/451] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:15 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:16.160488 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-f20e4f2c-9917-4aeb-a535-915391ff977b req-9a9cd5cc-314e-4c3e-8981-dce4fd4da468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47633cfc-a1d3-41c4-ab31-71cd28896c05", "tag": "e8531efb-6d29-4faf-9d0d-838641bb6d52"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:53:16.185484 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-f20e4f2c-9917-4aeb-a535-915391ff977b req-9a9cd5cc-314e-4c3e-8981-dce4fd4da468 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:16.187905 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-f20e4f2c-9917-4aeb-a535-915391ff977b req-9a9cd5cc-314e-4c3e-8981-dce4fd4da468 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:16.188603 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-f20e4f2c-9917-4aeb-a535-915391ff977b req-9a9cd5cc-314e-4c3e-8981-dce4fd4da468 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:16.217235 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-f20e4f2c-9917-4aeb-a535-915391ff977b req-9a9cd5cc-314e-4c3e-8981-dce4fd4da468 service nova] Creating event network-changed:e8531efb-6d29-4faf-9d0d-838641bb6d52 for instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 on hv-cinder-84456 Oct 03 12:53:16.225765 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-f20e4f2c-9917-4aeb-a535-915391ff977b req-9a9cd5cc-314e-4c3e-8981-dce4fd4da468 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071148 Oct 03 12:53:16.227062 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 227/452] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:53:16.376007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c43d7390-afd4-4eae-9164-a77b52cd35ec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:16.376951 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c43d7390-afd4-4eae-9164-a77b52cd35ec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:16.384333 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c43d7390-afd4-4eae-9164-a77b52cd35ec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:16.385050 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c43d7390-afd4-4eae-9164-a77b52cd35ec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:16.385498 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c43d7390-afd4-4eae-9164-a77b52cd35ec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:16.386216 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c43d7390-afd4-4eae-9164-a77b52cd35ec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:16.386675 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c43d7390-afd4-4eae-9164-a77b52cd35ec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:16.387098 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c43d7390-afd4-4eae-9164-a77b52cd35ec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:16.594420 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c43d7390-afd4-4eae-9164-a77b52cd35ec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:16.605645 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c43d7390-afd4-4eae-9164-a77b52cd35ec tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1677 microversion: 2.1 time: 0.234039 Oct 03 12:53:16.607356 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 226/453] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:16 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1677 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:16.896719 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e140ac92-ced6-4605-83d8-ec51928d5d88 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:16.897689 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-e140ac92-ced6-4605-83d8-ec51928d5d88 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:16.905172 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e140ac92-ced6-4605-83d8-ec51928d5d88 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:16.906094 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e140ac92-ced6-4605-83d8-ec51928d5d88 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:16.906705 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e140ac92-ced6-4605-83d8-ec51928d5d88 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:16.910070 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e140ac92-ced6-4605-83d8-ec51928d5d88 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:16.910070 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e140ac92-ced6-4605-83d8-ec51928d5d88 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:16.910070 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e140ac92-ced6-4605-83d8-ec51928d5d88 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:17.091252 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e140ac92-ced6-4605-83d8-ec51928d5d88 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:17.100593 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e140ac92-ced6-4605-83d8-ec51928d5d88 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:17.102342 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e140ac92-ced6-4605-83d8-ec51928d5d88 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:17.112407 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e140ac92-ced6-4605-83d8-ec51928d5d88 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.220633 Oct 03 12:53:17.112990 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 228/454] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:16 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:17.629589 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-db76c46f-efbb-4d03-9f66-5bb9db798172 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:17.630207 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-db76c46f-efbb-4d03-9f66-5bb9db798172 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:17.637079 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-db76c46f-efbb-4d03-9f66-5bb9db798172 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:17.637577 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-db76c46f-efbb-4d03-9f66-5bb9db798172 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:17.638017 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-db76c46f-efbb-4d03-9f66-5bb9db798172 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:17.638718 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-db76c46f-efbb-4d03-9f66-5bb9db798172 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:17.639370 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-db76c46f-efbb-4d03-9f66-5bb9db798172 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:17.639957 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-db76c46f-efbb-4d03-9f66-5bb9db798172 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:17.778380 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-db76c46f-efbb-4d03-9f66-5bb9db798172 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:17.787467 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-db76c46f-efbb-4d03-9f66-5bb9db798172 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1677 microversion: 2.1 time: 0.161711 Oct 03 12:53:17.788267 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 227/455] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:17 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:53:18.139090 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-50516e46-d32f-496a-8a6f-25e8a7ba144e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:18.139732 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-50516e46-d32f-496a-8a6f-25e8a7ba144e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:18.146357 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50516e46-d32f-496a-8a6f-25e8a7ba144e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:18.146867 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50516e46-d32f-496a-8a6f-25e8a7ba144e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:18.148897 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50516e46-d32f-496a-8a6f-25e8a7ba144e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:18.148897 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50516e46-d32f-496a-8a6f-25e8a7ba144e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:18.148897 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50516e46-d32f-496a-8a6f-25e8a7ba144e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:18.148897 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50516e46-d32f-496a-8a6f-25e8a7ba144e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:18.163177 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:18.288371 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-50516e46-d32f-496a-8a6f-25e8a7ba144e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:18.296833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-50516e46-d32f-496a-8a6f-25e8a7ba144e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:18.298272 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-50516e46-d32f-496a-8a6f-25e8a7ba144e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:18.300184 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-50516e46-d32f-496a-8a6f-25e8a7ba144e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.164979 Oct 03 12:53:18.300739 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 229/456] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:18 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:18.811732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-579f531d-9fe0-40fa-ad65-24c00e3584dd tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:18.812353 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-579f531d-9fe0-40fa-ad65-24c00e3584dd tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:18.819779 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-579f531d-9fe0-40fa-ad65-24c00e3584dd tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:18.820278 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-579f531d-9fe0-40fa-ad65-24c00e3584dd tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:18.820746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-579f531d-9fe0-40fa-ad65-24c00e3584dd tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:18.821450 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-579f531d-9fe0-40fa-ad65-24c00e3584dd tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:18.821914 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-579f531d-9fe0-40fa-ad65-24c00e3584dd tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:18.822345 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-579f531d-9fe0-40fa-ad65-24c00e3584dd tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:19.007880 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-579f531d-9fe0-40fa-ad65-24c00e3584dd tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:19.015648 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-579f531d-9fe0-40fa-ad65-24c00e3584dd tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1677 microversion: 2.1 time: 0.207570 Oct 03 12:53:19.016225 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 228/457] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:18 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1677 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:53:19.325876 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8b325eae-a29f-451c-9fec-c508a1c4457a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:19.327207 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8b325eae-a29f-451c-9fec-c508a1c4457a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:19.336738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8b325eae-a29f-451c-9fec-c508a1c4457a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:19.343859 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8b325eae-a29f-451c-9fec-c508a1c4457a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:19.343859 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8b325eae-a29f-451c-9fec-c508a1c4457a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:19.343859 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8b325eae-a29f-451c-9fec-c508a1c4457a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:19.343859 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8b325eae-a29f-451c-9fec-c508a1c4457a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:19.344215 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8b325eae-a29f-451c-9fec-c508a1c4457a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:19.496573 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8b325eae-a29f-451c-9fec-c508a1c4457a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:19.508802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8b325eae-a29f-451c-9fec-c508a1c4457a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:19.510465 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8b325eae-a29f-451c-9fec-c508a1c4457a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:19.511661 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-8b325eae-a29f-451c-9fec-c508a1c4457a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.189443 Oct 03 12:53:19.512068 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 230/458] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:19 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:20.039167 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3a0f6f6d-8d52-40ec-a30c-1293372ca34f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:20.039895 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3a0f6f6d-8d52-40ec-a30c-1293372ca34f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:20.046513 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3a0f6f6d-8d52-40ec-a30c-1293372ca34f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:20.047016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3a0f6f6d-8d52-40ec-a30c-1293372ca34f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:20.047504 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3a0f6f6d-8d52-40ec-a30c-1293372ca34f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:20.050121 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3a0f6f6d-8d52-40ec-a30c-1293372ca34f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:20.050121 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3a0f6f6d-8d52-40ec-a30c-1293372ca34f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:20.050121 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3a0f6f6d-8d52-40ec-a30c-1293372ca34f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:20.188661 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3a0f6f6d-8d52-40ec-a30c-1293372ca34f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:20.197102 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3a0f6f6d-8d52-40ec-a30c-1293372ca34f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1677 microversion: 2.1 time: 0.161788 Oct 03 12:53:20.197679 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 229/459] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:20 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:20.537974 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-1982b78c-5d76-43da-a51e-de06323321b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:20.539208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-1982b78c-5d76-43da-a51e-de06323321b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:20.545429 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1982b78c-5d76-43da-a51e-de06323321b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:20.545921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1982b78c-5d76-43da-a51e-de06323321b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:20.546363 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1982b78c-5d76-43da-a51e-de06323321b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:20.547068 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1982b78c-5d76-43da-a51e-de06323321b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:20.547557 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1982b78c-5d76-43da-a51e-de06323321b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:20.549447 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1982b78c-5d76-43da-a51e-de06323321b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:20.690471 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-1982b78c-5d76-43da-a51e-de06323321b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:20.699531 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-1982b78c-5d76-43da-a51e-de06323321b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:20.701003 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-1982b78c-5d76-43da-a51e-de06323321b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:20.702198 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-1982b78c-5d76-43da-a51e-de06323321b9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.168342 Oct 03 12:53:20.703053 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 231/460] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:20 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:20.767394 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-afb4145f-7b77-4ce5-8ab9-03570edf1c35 req-90948226-c4f3-4a51-a1a8-dd0d9ab22015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54982238-81ba-4d23-b642-e3a37f778b4a", "name": "network-vif-plugged", "status": "completed", "tag": "e846a01d-6972-40c0-b292-bc930ec8ca6d"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:53:20.777361 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-afb4145f-7b77-4ce5-8ab9-03570edf1c35 req-90948226-c4f3-4a51-a1a8-dd0d9ab22015 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:20.777850 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-afb4145f-7b77-4ce5-8ab9-03570edf1c35 req-90948226-c4f3-4a51-a1a8-dd0d9ab22015 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:20.778287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-afb4145f-7b77-4ce5-8ab9-03570edf1c35 req-90948226-c4f3-4a51-a1a8-dd0d9ab22015 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:20.793857 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-afb4145f-7b77-4ce5-8ab9-03570edf1c35 req-90948226-c4f3-4a51-a1a8-dd0d9ab22015 service nova] Creating event network-vif-plugged:e846a01d-6972-40c0-b292-bc930ec8ca6d for instance 54982238-81ba-4d23-b642-e3a37f778b4a on hv-cinder-84456 Oct 03 12:53:20.799721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-afb4145f-7b77-4ce5-8ab9-03570edf1c35 req-90948226-c4f3-4a51-a1a8-dd0d9ab22015 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035309 Oct 03 12:53:20.802370 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 230/461] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:53:21.222664 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b68c0db3-c046-42b2-94f9-100c273cba1d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:21.223328 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-b68c0db3-c046-42b2-94f9-100c273cba1d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:21.229473 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b68c0db3-c046-42b2-94f9-100c273cba1d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:21.229956 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b68c0db3-c046-42b2-94f9-100c273cba1d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:21.230392 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b68c0db3-c046-42b2-94f9-100c273cba1d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:21.231071 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b68c0db3-c046-42b2-94f9-100c273cba1d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:21.231554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b68c0db3-c046-42b2-94f9-100c273cba1d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:21.231975 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b68c0db3-c046-42b2-94f9-100c273cba1d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:21.372261 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-b68c0db3-c046-42b2-94f9-100c273cba1d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:21.380767 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-b68c0db3-c046-42b2-94f9-100c273cba1d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1677 microversion: 2.1 time: 0.162715 Oct 03 12:53:21.381330 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 232/462] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:21 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:21.679046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f3f6ae1e-c129-48db-bb36-ecf5425aca98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:53:21.681369 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f3f6ae1e-c129-48db-bb36-ecf5425aca98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:21.687436 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3f6ae1e-c129-48db-bb36-ecf5425aca98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:21.687916 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3f6ae1e-c129-48db-bb36-ecf5425aca98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:21.688350 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3f6ae1e-c129-48db-bb36-ecf5425aca98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:21.689030 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3f6ae1e-c129-48db-bb36-ecf5425aca98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:21.690513 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3f6ae1e-c129-48db-bb36-ecf5425aca98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:21.690513 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3f6ae1e-c129-48db-bb36-ecf5425aca98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:21.714704 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-f3f6ae1e-c129-48db-bb36-ecf5425aca98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lazy-loading 'flavor' on Instance uuid 85d3f4ae-60a5-4463-9a02-00d846d22289 {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:53:21.737688 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-36c761aa-7eb3-4b74-8504-48f79c4a53e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:21.738397 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-36c761aa-7eb3-4b74-8504-48f79c4a53e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:21.745255 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36c761aa-7eb3-4b74-8504-48f79c4a53e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:21.746393 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36c761aa-7eb3-4b74-8504-48f79c4a53e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:21.746499 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36c761aa-7eb3-4b74-8504-48f79c4a53e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:21.747122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36c761aa-7eb3-4b74-8504-48f79c4a53e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:21.747597 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36c761aa-7eb3-4b74-8504-48f79c4a53e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:21.748019 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36c761aa-7eb3-4b74-8504-48f79c4a53e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:21.836942 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:21.885525 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-36c761aa-7eb3-4b74-8504-48f79c4a53e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:21.896495 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-36c761aa-7eb3-4b74-8504-48f79c4a53e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:21.899165 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-36c761aa-7eb3-4b74-8504-48f79c4a53e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:21.901086 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-36c761aa-7eb3-4b74-8504-48f79c4a53e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.167535 Oct 03 12:53:21.901919 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 233/463] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:21 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:53:22.093019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f3f6ae1e-c129-48db-bb36-ecf5425aca98 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "POST /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/action" status: 200 len: 32 microversion: 2.1 time: 0.418535 Oct 03 12:53:22.093556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 231/464] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 12:53:21 2022] POST /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/action => generated 32 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 12:53:22.103657 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-24d6a0af-d0c4-43dc-b916-275ec81c9dbb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:22.104283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-24d6a0af-d0c4-43dc-b916-275ec81c9dbb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:22.111016 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24d6a0af-d0c4-43dc-b916-275ec81c9dbb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:22.112427 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24d6a0af-d0c4-43dc-b916-275ec81c9dbb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:22.112878 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24d6a0af-d0c4-43dc-b916-275ec81c9dbb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:22.116687 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24d6a0af-d0c4-43dc-b916-275ec81c9dbb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:22.116687 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24d6a0af-d0c4-43dc-b916-275ec81c9dbb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:22.116687 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24d6a0af-d0c4-43dc-b916-275ec81c9dbb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:22.248889 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-24d6a0af-d0c4-43dc-b916-275ec81c9dbb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:22.257470 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-24d6a0af-d0c4-43dc-b916-275ec81c9dbb tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.157537 Oct 03 12:53:22.258029 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 234/465] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:22 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:22.406578 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7b156a43-ec9a-4c05-88df-ef911ae14d2b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:22.407484 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-7b156a43-ec9a-4c05-88df-ef911ae14d2b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:22.414922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b156a43-ec9a-4c05-88df-ef911ae14d2b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:22.415736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b156a43-ec9a-4c05-88df-ef911ae14d2b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:22.416253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b156a43-ec9a-4c05-88df-ef911ae14d2b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:22.417176 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b156a43-ec9a-4c05-88df-ef911ae14d2b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:22.417604 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b156a43-ec9a-4c05-88df-ef911ae14d2b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:22.418034 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b156a43-ec9a-4c05-88df-ef911ae14d2b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:22.557250 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-7b156a43-ec9a-4c05-88df-ef911ae14d2b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:22.565783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-7b156a43-ec9a-4c05-88df-ef911ae14d2b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1677 microversion: 2.1 time: 0.163908 Oct 03 12:53:22.566378 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 232/466] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:22 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:22.931222 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-4baffdbb-fc95-4644-84a7-f9b5b8381d5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:22.932118 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-4baffdbb-fc95-4644-84a7-f9b5b8381d5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:22.939721 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4baffdbb-fc95-4644-84a7-f9b5b8381d5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:22.940216 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4baffdbb-fc95-4644-84a7-f9b5b8381d5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:22.940646 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4baffdbb-fc95-4644-84a7-f9b5b8381d5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:22.941358 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4baffdbb-fc95-4644-84a7-f9b5b8381d5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:22.941814 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4baffdbb-fc95-4644-84a7-f9b5b8381d5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:22.942235 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4baffdbb-fc95-4644-84a7-f9b5b8381d5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:23.076821 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4baffdbb-fc95-4644-84a7-f9b5b8381d5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:23.086764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4baffdbb-fc95-4644-84a7-f9b5b8381d5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:23.088349 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4baffdbb-fc95-4644-84a7-f9b5b8381d5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:23.089516 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-4baffdbb-fc95-4644-84a7-f9b5b8381d5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.162347 Oct 03 12:53:23.090076 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 235/467] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:22 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:53:23.281643 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-20113d7e-1c88-48b9-8901-9628539313b4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:23.282427 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-20113d7e-1c88-48b9-8901-9628539313b4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:23.285712 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=4 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:23.290845 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-20113d7e-1c88-48b9-8901-9628539313b4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:23.291366 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-20113d7e-1c88-48b9-8901-9628539313b4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:23.291813 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-20113d7e-1c88-48b9-8901-9628539313b4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:23.292519 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-20113d7e-1c88-48b9-8901-9628539313b4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:23.292973 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-20113d7e-1c88-48b9-8901-9628539313b4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:23.293397 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-20113d7e-1c88-48b9-8901-9628539313b4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:23.429800 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-20113d7e-1c88-48b9-8901-9628539313b4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:23.440469 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-20113d7e-1c88-48b9-8901-9628539313b4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.163067 Oct 03 12:53:23.442157 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 233/468] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:23 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:23.588183 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-1cd85a86-4b03-444e-8377-8149b3dca3a8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:23.588856 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-1cd85a86-4b03-444e-8377-8149b3dca3a8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:23.594986 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cd85a86-4b03-444e-8377-8149b3dca3a8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:23.595538 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cd85a86-4b03-444e-8377-8149b3dca3a8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:23.596192 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cd85a86-4b03-444e-8377-8149b3dca3a8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:23.596931 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cd85a86-4b03-444e-8377-8149b3dca3a8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:23.597334 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cd85a86-4b03-444e-8377-8149b3dca3a8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:23.597748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cd85a86-4b03-444e-8377-8149b3dca3a8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:23.793706 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-1cd85a86-4b03-444e-8377-8149b3dca3a8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:23.802864 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-1cd85a86-4b03-444e-8377-8149b3dca3a8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1677 microversion: 2.1 time: 0.218373 Oct 03 12:53:23.804649 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 236/469] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:23 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:24.119278 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3338fdd7-ea81-40ed-b460-f40ede48338a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:24.119844 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3338fdd7-ea81-40ed-b460-f40ede48338a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:24.126477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3338fdd7-ea81-40ed-b460-f40ede48338a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:24.127017 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3338fdd7-ea81-40ed-b460-f40ede48338a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:24.131768 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3338fdd7-ea81-40ed-b460-f40ede48338a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:24.131768 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3338fdd7-ea81-40ed-b460-f40ede48338a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:24.131768 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3338fdd7-ea81-40ed-b460-f40ede48338a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:24.131768 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3338fdd7-ea81-40ed-b460-f40ede48338a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:24.257602 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3338fdd7-ea81-40ed-b460-f40ede48338a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:24.266241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3338fdd7-ea81-40ed-b460-f40ede48338a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:24.268224 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3338fdd7-ea81-40ed-b460-f40ede48338a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:24.269528 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3338fdd7-ea81-40ed-b460-f40ede48338a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1809 microversion: 2.20 time: 0.157019 Oct 03 12:53:24.270089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 234/470] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:24 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:24.467994 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c4db611d-c28b-4435-b2a7-7cada37dd6f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:24.468537 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-c4db611d-c28b-4435-b2a7-7cada37dd6f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:24.475126 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c4db611d-c28b-4435-b2a7-7cada37dd6f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:24.475656 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c4db611d-c28b-4435-b2a7-7cada37dd6f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:24.476119 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c4db611d-c28b-4435-b2a7-7cada37dd6f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:24.476858 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c4db611d-c28b-4435-b2a7-7cada37dd6f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:24.477319 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c4db611d-c28b-4435-b2a7-7cada37dd6f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:24.477746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c4db611d-c28b-4435-b2a7-7cada37dd6f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:24.615332 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c4db611d-c28b-4435-b2a7-7cada37dd6f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:24.624528 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c4db611d-c28b-4435-b2a7-7cada37dd6f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.160429 Oct 03 12:53:24.625117 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 237/471] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:24 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:24.827939 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-251b3463-71d9-49c3-b18c-379c4a462476 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:24.829632 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-251b3463-71d9-49c3-b18c-379c4a462476 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:24.839960 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-251b3463-71d9-49c3-b18c-379c4a462476 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:24.841032 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-251b3463-71d9-49c3-b18c-379c4a462476 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:24.842156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-251b3463-71d9-49c3-b18c-379c4a462476 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:24.843445 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-251b3463-71d9-49c3-b18c-379c4a462476 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:24.844504 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-251b3463-71d9-49c3-b18c-379c4a462476 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:24.845011 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-251b3463-71d9-49c3-b18c-379c4a462476 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:24.988116 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-251b3463-71d9-49c3-b18c-379c4a462476 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:24.996181 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-251b3463-71d9-49c3-b18c-379c4a462476 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1677 microversion: 2.1 time: 0.174049 Oct 03 12:53:24.996755 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 235/472] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:24 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:25.294575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8bbc9ea2-6ce4-408f-b35b-6894fe73d0c0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:25.294884 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8bbc9ea2-6ce4-408f-b35b-6894fe73d0c0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:25.305001 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8bbc9ea2-6ce4-408f-b35b-6894fe73d0c0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:25.305001 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8bbc9ea2-6ce4-408f-b35b-6894fe73d0c0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:25.305001 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8bbc9ea2-6ce4-408f-b35b-6894fe73d0c0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:25.305001 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8bbc9ea2-6ce4-408f-b35b-6894fe73d0c0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:25.305540 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8bbc9ea2-6ce4-408f-b35b-6894fe73d0c0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:25.305950 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8bbc9ea2-6ce4-408f-b35b-6894fe73d0c0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:25.473739 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8bbc9ea2-6ce4-408f-b35b-6894fe73d0c0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:25.482873 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8bbc9ea2-6ce4-408f-b35b-6894fe73d0c0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:25.484465 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8bbc9ea2-6ce4-408f-b35b-6894fe73d0c0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:25.485839 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-8bbc9ea2-6ce4-408f-b35b-6894fe73d0c0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1796 microversion: 2.20 time: 0.195704 Oct 03 12:53:25.487791 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 238/473] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:53:25 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1796 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:53:25.648594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-25f1293e-2442-431a-a739-99135f006d2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:25.649209 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-25f1293e-2442-431a-a739-99135f006d2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:25.655020 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-25f1293e-2442-431a-a739-99135f006d2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:25.655544 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-25f1293e-2442-431a-a739-99135f006d2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:25.656099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-25f1293e-2442-431a-a739-99135f006d2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:25.656872 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-25f1293e-2442-431a-a739-99135f006d2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:25.657665 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-25f1293e-2442-431a-a739-99135f006d2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:25.659007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-25f1293e-2442-431a-a739-99135f006d2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:25.797005 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-25f1293e-2442-431a-a739-99135f006d2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:25.805938 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-25f1293e-2442-431a-a739-99135f006d2c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.161552 Oct 03 12:53:25.806764 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 236/474] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:25 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:26.022074 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9d828ca1-ddef-40ab-a23d-ead73f55f4bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:26.022802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-9d828ca1-ddef-40ab-a23d-ead73f55f4bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:26.030250 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d828ca1-ddef-40ab-a23d-ead73f55f4bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:26.030758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d828ca1-ddef-40ab-a23d-ead73f55f4bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:26.031257 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d828ca1-ddef-40ab-a23d-ead73f55f4bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:26.032053 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d828ca1-ddef-40ab-a23d-ead73f55f4bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:26.032522 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d828ca1-ddef-40ab-a23d-ead73f55f4bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:26.032972 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d828ca1-ddef-40ab-a23d-ead73f55f4bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:26.170257 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9d828ca1-ddef-40ab-a23d-ead73f55f4bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:26.178463 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-9d828ca1-ddef-40ab-a23d-ead73f55f4bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1677 microversion: 2.1 time: 0.160850 Oct 03 12:53:26.179040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 239/475] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:26 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:26.830541 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c21c3933-a6ef-451f-8a8f-1611dc7bfb2d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:26.831077 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c21c3933-a6ef-451f-8a8f-1611dc7bfb2d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:26.837961 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c21c3933-a6ef-451f-8a8f-1611dc7bfb2d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:26.838318 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c21c3933-a6ef-451f-8a8f-1611dc7bfb2d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:26.838756 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c21c3933-a6ef-451f-8a8f-1611dc7bfb2d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:26.839635 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c21c3933-a6ef-451f-8a8f-1611dc7bfb2d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:26.839937 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c21c3933-a6ef-451f-8a8f-1611dc7bfb2d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:26.840358 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c21c3933-a6ef-451f-8a8f-1611dc7bfb2d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:26.985636 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c21c3933-a6ef-451f-8a8f-1611dc7bfb2d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:26.995480 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c21c3933-a6ef-451f-8a8f-1611dc7bfb2d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.169836 Oct 03 12:53:26.996152 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 237/476] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:26 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:27.202027 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ee332d73-8a00-4996-87ca-cfdc55790c84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:27.202647 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ee332d73-8a00-4996-87ca-cfdc55790c84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:27.209067 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ee332d73-8a00-4996-87ca-cfdc55790c84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:27.209556 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ee332d73-8a00-4996-87ca-cfdc55790c84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:27.209995 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ee332d73-8a00-4996-87ca-cfdc55790c84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:27.210721 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ee332d73-8a00-4996-87ca-cfdc55790c84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:27.211181 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ee332d73-8a00-4996-87ca-cfdc55790c84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:27.211638 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ee332d73-8a00-4996-87ca-cfdc55790c84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:27.357159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-ee332d73-8a00-4996-87ca-cfdc55790c84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:27.365564 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ee332d73-8a00-4996-87ca-cfdc55790c84 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1677 microversion: 2.1 time: 0.167500 Oct 03 12:53:27.366127 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 240/477] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:27 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:28.019096 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-83f430b1-9a94-461f-8ef4-3e6988bb3c1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:28.019863 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-83f430b1-9a94-461f-8ef4-3e6988bb3c1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:28.026160 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-83f430b1-9a94-461f-8ef4-3e6988bb3c1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:28.026765 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-83f430b1-9a94-461f-8ef4-3e6988bb3c1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:28.027200 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-83f430b1-9a94-461f-8ef4-3e6988bb3c1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:28.027919 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-83f430b1-9a94-461f-8ef4-3e6988bb3c1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:28.028403 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-83f430b1-9a94-461f-8ef4-3e6988bb3c1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:28.028948 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-83f430b1-9a94-461f-8ef4-3e6988bb3c1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:28.158951 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-83f430b1-9a94-461f-8ef4-3e6988bb3c1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:28.167196 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-83f430b1-9a94-461f-8ef4-3e6988bb3c1b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.152632 Oct 03 12:53:28.167783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 238/478] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:28 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:28.389096 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9d1d115f-233a-49d6-bb16-7932525979a4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:28.389732 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-9d1d115f-233a-49d6-bb16-7932525979a4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:28.396688 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d1d115f-233a-49d6-bb16-7932525979a4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:28.397162 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d1d115f-233a-49d6-bb16-7932525979a4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:28.397626 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d1d115f-233a-49d6-bb16-7932525979a4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:28.398305 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d1d115f-233a-49d6-bb16-7932525979a4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:28.398753 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d1d115f-233a-49d6-bb16-7932525979a4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:28.399172 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d1d115f-233a-49d6-bb16-7932525979a4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:28.538151 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9d1d115f-233a-49d6-bb16-7932525979a4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:28.546104 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-9d1d115f-233a-49d6-bb16-7932525979a4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1677 microversion: 2.1 time: 0.160908 Oct 03 12:53:28.546746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 241/479] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:28 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:29.191154 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-36f58227-46dc-4533-8179-e4b572de73d2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:29.191824 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-36f58227-46dc-4533-8179-e4b572de73d2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:29.198108 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36f58227-46dc-4533-8179-e4b572de73d2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:29.198744 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36f58227-46dc-4533-8179-e4b572de73d2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:29.199182 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36f58227-46dc-4533-8179-e4b572de73d2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:29.199970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36f58227-46dc-4533-8179-e4b572de73d2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:29.200357 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36f58227-46dc-4533-8179-e4b572de73d2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:29.200782 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36f58227-46dc-4533-8179-e4b572de73d2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:29.352440 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-36f58227-46dc-4533-8179-e4b572de73d2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:29.361619 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-36f58227-46dc-4533-8179-e4b572de73d2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.174114 Oct 03 12:53:29.362286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 239/480] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:29 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:29.570360 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-fd4e4b78-1107-4b61-b02a-ce3b21bd08ed tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:29.570972 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-fd4e4b78-1107-4b61-b02a-ce3b21bd08ed tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:29.577573 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fd4e4b78-1107-4b61-b02a-ce3b21bd08ed tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:29.578065 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fd4e4b78-1107-4b61-b02a-ce3b21bd08ed tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:29.578503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fd4e4b78-1107-4b61-b02a-ce3b21bd08ed tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:29.579200 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fd4e4b78-1107-4b61-b02a-ce3b21bd08ed tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:29.579688 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fd4e4b78-1107-4b61-b02a-ce3b21bd08ed tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:29.580263 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fd4e4b78-1107-4b61-b02a-ce3b21bd08ed tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:29.717359 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-fd4e4b78-1107-4b61-b02a-ce3b21bd08ed tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:29.725494 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-fd4e4b78-1107-4b61-b02a-ce3b21bd08ed tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1654 microversion: 2.1 time: 0.158998 Oct 03 12:53:29.726078 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 242/481] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:29 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1654 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:29.749103 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-09920757-ed8c-4ebb-8c25-3a5e83c90eb8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:53:29.755255 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-09920757-ed8c-4ebb-8c25-3a5e83c90eb8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:29.755805 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-09920757-ed8c-4ebb-8c25-3a5e83c90eb8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:29.756241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-09920757-ed8c-4ebb-8c25-3a5e83c90eb8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:29.777956 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-09920757-ed8c-4ebb-8c25-3a5e83c90eb8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Going to try to start instance {{(pid=127542) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 12:53:29.941990 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-09920757-ed8c-4ebb-8c25-3a5e83c90eb8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "POST /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/action" status: 202 len: 0 microversion: 2.1 time: 0.196883 Oct 03 12:53:29.942519 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 240/482] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 12:53:29 2022] POST /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:53:29.950765 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-58c0fb4f-0175-4463-8b30-4c69c139a655 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:29.951409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-58c0fb4f-0175-4463-8b30-4c69c139a655 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:29.957752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-58c0fb4f-0175-4463-8b30-4c69c139a655 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:29.958241 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-58c0fb4f-0175-4463-8b30-4c69c139a655 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:29.958685 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-58c0fb4f-0175-4463-8b30-4c69c139a655 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:29.959413 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-58c0fb4f-0175-4463-8b30-4c69c139a655 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:29.959876 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-58c0fb4f-0175-4463-8b30-4c69c139a655 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:29.960304 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-58c0fb4f-0175-4463-8b30-4c69c139a655 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:30.089831 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-58c0fb4f-0175-4463-8b30-4c69c139a655 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:30.098313 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-58c0fb4f-0175-4463-8b30-4c69c139a655 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1663 microversion: 2.1 time: 0.151344 Oct 03 12:53:30.098885 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 243/483] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:29 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:30.386851 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-fafc0771-70ee-4d8a-81b8-2f5123acc24a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:30.387585 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-fafc0771-70ee-4d8a-81b8-2f5123acc24a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:30.394331 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fafc0771-70ee-4d8a-81b8-2f5123acc24a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:30.394828 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fafc0771-70ee-4d8a-81b8-2f5123acc24a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:30.395254 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fafc0771-70ee-4d8a-81b8-2f5123acc24a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:30.395970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fafc0771-70ee-4d8a-81b8-2f5123acc24a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:30.396428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fafc0771-70ee-4d8a-81b8-2f5123acc24a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:30.396853 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fafc0771-70ee-4d8a-81b8-2f5123acc24a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:30.524474 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-fafc0771-70ee-4d8a-81b8-2f5123acc24a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:30.532601 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-fafc0771-70ee-4d8a-81b8-2f5123acc24a tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.150467 Oct 03 12:53:30.534123 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 241/484] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:30 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:31.122496 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bc4d129a-1874-4cb8-86b6-b100a0d95241 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:31.123102 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-bc4d129a-1874-4cb8-86b6-b100a0d95241 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:31.129990 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bc4d129a-1874-4cb8-86b6-b100a0d95241 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:31.130468 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bc4d129a-1874-4cb8-86b6-b100a0d95241 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:31.130899 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bc4d129a-1874-4cb8-86b6-b100a0d95241 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:31.131605 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bc4d129a-1874-4cb8-86b6-b100a0d95241 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:31.132054 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bc4d129a-1874-4cb8-86b6-b100a0d95241 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:31.132472 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bc4d129a-1874-4cb8-86b6-b100a0d95241 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:31.264615 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-bc4d129a-1874-4cb8-86b6-b100a0d95241 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:31.272602 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-bc4d129a-1874-4cb8-86b6-b100a0d95241 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1663 microversion: 2.1 time: 0.153940 Oct 03 12:53:31.273176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 244/485] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:31 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:31.556733 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-2bf61c27-20db-4ad2-80e7-51461d02ea68 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:31.557355 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-2bf61c27-20db-4ad2-80e7-51461d02ea68 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:31.563863 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2bf61c27-20db-4ad2-80e7-51461d02ea68 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:31.564565 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2bf61c27-20db-4ad2-80e7-51461d02ea68 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:31.565008 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2bf61c27-20db-4ad2-80e7-51461d02ea68 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:31.565779 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2bf61c27-20db-4ad2-80e7-51461d02ea68 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:31.566243 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2bf61c27-20db-4ad2-80e7-51461d02ea68 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:31.566673 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2bf61c27-20db-4ad2-80e7-51461d02ea68 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:31.696206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-2bf61c27-20db-4ad2-80e7-51461d02ea68 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:31.704318 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-2bf61c27-20db-4ad2-80e7-51461d02ea68 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.151604 Oct 03 12:53:31.705060 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 242/486] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:31 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:32.295680 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b18a5800-b436-4d9f-a0a8-22388c4ce94e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:32.296295 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-b18a5800-b436-4d9f-a0a8-22388c4ce94e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:32.303394 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b18a5800-b436-4d9f-a0a8-22388c4ce94e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:32.303881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b18a5800-b436-4d9f-a0a8-22388c4ce94e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:32.304313 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b18a5800-b436-4d9f-a0a8-22388c4ce94e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:32.304999 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b18a5800-b436-4d9f-a0a8-22388c4ce94e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:32.305450 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b18a5800-b436-4d9f-a0a8-22388c4ce94e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:32.305871 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b18a5800-b436-4d9f-a0a8-22388c4ce94e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:32.442293 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-b18a5800-b436-4d9f-a0a8-22388c4ce94e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:32.450297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-b18a5800-b436-4d9f-a0a8-22388c4ce94e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1663 microversion: 2.1 time: 0.158442 Oct 03 12:53:32.450803 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 245/487] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:32 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:32.727337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c784d1ec-cc82-45de-8633-5a67105327ea tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:32.727956 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c784d1ec-cc82-45de-8633-5a67105327ea tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:32.734069 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c784d1ec-cc82-45de-8633-5a67105327ea tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:32.734556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c784d1ec-cc82-45de-8633-5a67105327ea tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:32.734987 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c784d1ec-cc82-45de-8633-5a67105327ea tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:32.735703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c784d1ec-cc82-45de-8633-5a67105327ea tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:32.736161 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c784d1ec-cc82-45de-8633-5a67105327ea tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:32.736582 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c784d1ec-cc82-45de-8633-5a67105327ea tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:32.870973 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c784d1ec-cc82-45de-8633-5a67105327ea tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:32.880264 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c784d1ec-cc82-45de-8633-5a67105327ea tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.156677 Oct 03 12:53:32.880831 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 243/488] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:32 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:33.473300 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-72d865d0-4342-4988-8b72-af8d42207ca8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:33.474125 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-72d865d0-4342-4988-8b72-af8d42207ca8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:33.480841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-72d865d0-4342-4988-8b72-af8d42207ca8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:33.481272 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-72d865d0-4342-4988-8b72-af8d42207ca8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:33.481712 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-72d865d0-4342-4988-8b72-af8d42207ca8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:33.482410 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-72d865d0-4342-4988-8b72-af8d42207ca8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:33.482866 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-72d865d0-4342-4988-8b72-af8d42207ca8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:33.483300 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-72d865d0-4342-4988-8b72-af8d42207ca8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:33.489343 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=100 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:33.619194 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-72d865d0-4342-4988-8b72-af8d42207ca8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:33.626930 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-72d865d0-4342-4988-8b72-af8d42207ca8 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1663 microversion: 2.1 time: 0.158041 Oct 03 12:53:33.627627 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 246/489] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:33 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:33.903664 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8c97aed3-b79e-405e-9d43-9294365ee1fa tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:33.904238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8c97aed3-b79e-405e-9d43-9294365ee1fa tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:33.910823 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c97aed3-b79e-405e-9d43-9294365ee1fa tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:33.911332 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c97aed3-b79e-405e-9d43-9294365ee1fa tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:33.911783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c97aed3-b79e-405e-9d43-9294365ee1fa tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:33.912476 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c97aed3-b79e-405e-9d43-9294365ee1fa tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:33.912933 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c97aed3-b79e-405e-9d43-9294365ee1fa tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:33.913364 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c97aed3-b79e-405e-9d43-9294365ee1fa tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:34.054415 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8c97aed3-b79e-405e-9d43-9294365ee1fa tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:34.062680 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8c97aed3-b79e-405e-9d43-9294365ee1fa tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.162973 Oct 03 12:53:34.063241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 244/490] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:33 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:34.651729 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b0bb5257-18aa-480b-b884-5aa17edf6e3a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:34.652338 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-b0bb5257-18aa-480b-b884-5aa17edf6e3a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:34.659273 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b0bb5257-18aa-480b-b884-5aa17edf6e3a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:34.660036 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b0bb5257-18aa-480b-b884-5aa17edf6e3a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:34.660262 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b0bb5257-18aa-480b-b884-5aa17edf6e3a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:34.660959 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b0bb5257-18aa-480b-b884-5aa17edf6e3a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:34.661417 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b0bb5257-18aa-480b-b884-5aa17edf6e3a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:34.661846 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b0bb5257-18aa-480b-b884-5aa17edf6e3a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:34.798943 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-b0bb5257-18aa-480b-b884-5aa17edf6e3a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:34.807617 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-b0bb5257-18aa-480b-b884-5aa17edf6e3a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1667 microversion: 2.1 time: 0.159612 Oct 03 12:53:34.808218 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 247/491] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:34 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1667 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:35.085919 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-258d1143-dce3-4784-a35d-989187a254f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:35.086544 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-258d1143-dce3-4784-a35d-989187a254f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:35.092953 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-258d1143-dce3-4784-a35d-989187a254f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:35.093437 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-258d1143-dce3-4784-a35d-989187a254f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:35.093874 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-258d1143-dce3-4784-a35d-989187a254f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:35.094564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-258d1143-dce3-4784-a35d-989187a254f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:35.095021 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-258d1143-dce3-4784-a35d-989187a254f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:35.095480 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-258d1143-dce3-4784-a35d-989187a254f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:35.225669 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-258d1143-dce3-4784-a35d-989187a254f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:35.234216 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-258d1143-dce3-4784-a35d-989187a254f0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.152122 Oct 03 12:53:35.234800 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 245/492] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:35 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:36.259038 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-693bedbd-463a-4c60-bd7a-332fa273546c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:36.259699 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-693bedbd-463a-4c60-bd7a-332fa273546c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:36.266151 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-693bedbd-463a-4c60-bd7a-332fa273546c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:36.266631 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-693bedbd-463a-4c60-bd7a-332fa273546c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:36.267060 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-693bedbd-463a-4c60-bd7a-332fa273546c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:36.267787 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-693bedbd-463a-4c60-bd7a-332fa273546c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:36.268329 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-693bedbd-463a-4c60-bd7a-332fa273546c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:36.268971 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-693bedbd-463a-4c60-bd7a-332fa273546c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:36.403762 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-693bedbd-463a-4c60-bd7a-332fa273546c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:36.412803 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-693bedbd-463a-4c60-bd7a-332fa273546c tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.158344 Oct 03 12:53:36.413726 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 248/493] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:36 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:37.437691 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8d598cca-7040-49ed-8e9b-a6ed66629b4e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:37.438336 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8d598cca-7040-49ed-8e9b-a6ed66629b4e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:37.445420 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d598cca-7040-49ed-8e9b-a6ed66629b4e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:37.448519 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d598cca-7040-49ed-8e9b-a6ed66629b4e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:37.448519 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d598cca-7040-49ed-8e9b-a6ed66629b4e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:37.448519 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d598cca-7040-49ed-8e9b-a6ed66629b4e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:37.448519 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d598cca-7040-49ed-8e9b-a6ed66629b4e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:37.448890 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d598cca-7040-49ed-8e9b-a6ed66629b4e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:37.452805 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:37.605213 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8d598cca-7040-49ed-8e9b-a6ed66629b4e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:37.612769 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8d598cca-7040-49ed-8e9b-a6ed66629b4e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.177970 Oct 03 12:53:37.613139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 246/494] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:37 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:53:38.596839 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1464273567", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2145702352", "security_groups": [{"name": "tempest-secgroup-smoke-1568243642"}], "networks": [{"uuid": "ce8a959a-d831-48ea-b008-5e2f6694b525"}], "block_device_mapping_v2": [{"uuid": "647ab120-eaee-4fb8-b094-d2ff5b33d1d1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:53:38.636409 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-00a0e662-8a57-4aac-aca5-158048382baf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:38.637025 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-00a0e662-8a57-4aac-aca5-158048382baf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:38.644925 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-00a0e662-8a57-4aac-aca5-158048382baf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:38.645510 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-00a0e662-8a57-4aac-aca5-158048382baf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:38.645832 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-00a0e662-8a57-4aac-aca5-158048382baf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:38.646528 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-00a0e662-8a57-4aac-aca5-158048382baf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:38.646980 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-00a0e662-8a57-4aac-aca5-158048382baf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:38.647426 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-00a0e662-8a57-4aac-aca5-158048382baf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:38.740137 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.network.neutron [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] validate_networks() for [('ce8a959a-d831-48ea-b008-5e2f6694b525', None, None, None, None, None)] {{(pid=127544) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:53:38.856600 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-00a0e662-8a57-4aac-aca5-158048382baf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:38.865583 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-00a0e662-8a57-4aac-aca5-158048382baf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.233179 Oct 03 12:53:38.866171 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 247/495] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:38 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:53:39.140678 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Flavor limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:53:39.141105 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Image limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:53:39.141579 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Flavor pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:53:39.141988 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Image pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:53:39.142407 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:53:39.151264 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:39.151774 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:39.152210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:39.152940 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:39.153393 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:39.153813 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:39.170806 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Getting quotas for project 06a284bf10ff47d6bc58de80f92c164a. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:53:39.175708 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Getting quotas for user bafb4a06c49d47cdb970e3f9e08a2543 and project 06a284bf10ff47d6bc58de80f92c164a. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:53:39.232449 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Going to run 1 instances... {{(pid=127544) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:53:39.234598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='647ab120-eaee-4fb8-b094-d2ff5b33d1d1',volume_size=None,volume_type=None)] {{(pid=127544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:53:39.770692 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d733d639-a68f-4fee-b78b-d0bbc4e2f661 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.177794 Oct 03 12:53:39.771634 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 249/496] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:53:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:53:39.782708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ad9262c2-dbc6-4296-88da-f1b45b50929b tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:39.783390 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-ad9262c2-dbc6-4296-88da-f1b45b50929b tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:39.841550 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-ad9262c2-dbc6-4296-88da-f1b45b50929b tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:39.849961 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-ad9262c2-dbc6-4296-88da-f1b45b50929b tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1089 microversion: 2.1 time: 0.071243 Oct 03 12:53:39.850566 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 248/497] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:39 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:39.889214 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-4f479bec-127d-4739-ba27-ec28f3365e17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:39.889836 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-4f479bec-127d-4739-ba27-ec28f3365e17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:39.896126 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f479bec-127d-4739-ba27-ec28f3365e17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:39.897480 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f479bec-127d-4739-ba27-ec28f3365e17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:39.897480 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f479bec-127d-4739-ba27-ec28f3365e17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:39.897867 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f479bec-127d-4739-ba27-ec28f3365e17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:39.898331 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f479bec-127d-4739-ba27-ec28f3365e17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:39.898761 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f479bec-127d-4739-ba27-ec28f3365e17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:40.032230 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4f479bec-127d-4739-ba27-ec28f3365e17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:40.040492 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-4f479bec-127d-4739-ba27-ec28f3365e17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.155273 Oct 03 12:53:40.041162 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 250/498] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:39 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:40.873575 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-48f42c03-d865-4cd2-b408-19bc43c60604 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:40.874188 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-48f42c03-d865-4cd2-b408-19bc43c60604 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:40.881348 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-48f42c03-d865-4cd2-b408-19bc43c60604 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:40.881831 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-48f42c03-d865-4cd2-b408-19bc43c60604 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:40.882265 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-48f42c03-d865-4cd2-b408-19bc43c60604 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:40.882951 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-48f42c03-d865-4cd2-b408-19bc43c60604 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:40.883432 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-48f42c03-d865-4cd2-b408-19bc43c60604 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:40.883858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-48f42c03-d865-4cd2-b408-19bc43c60604 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:40.950091 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-48f42c03-d865-4cd2-b408-19bc43c60604 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:40.958368 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-48f42c03-d865-4cd2-b408-19bc43c60604 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1139 microversion: 2.1 time: 0.088740 Oct 03 12:53:40.959025 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 249/499] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:40 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:41.063785 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-1cccccf6-16ad-46d9-990a-c5c07b34dc52 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:41.064404 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-1cccccf6-16ad-46d9-990a-c5c07b34dc52 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:41.071653 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cccccf6-16ad-46d9-990a-c5c07b34dc52 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:41.072200 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cccccf6-16ad-46d9-990a-c5c07b34dc52 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:41.072566 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cccccf6-16ad-46d9-990a-c5c07b34dc52 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:41.073259 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cccccf6-16ad-46d9-990a-c5c07b34dc52 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:41.073715 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cccccf6-16ad-46d9-990a-c5c07b34dc52 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:41.074138 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cccccf6-16ad-46d9-990a-c5c07b34dc52 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:41.212136 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-1cccccf6-16ad-46d9-990a-c5c07b34dc52 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:41.220389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-1cccccf6-16ad-46d9-990a-c5c07b34dc52 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.160411 Oct 03 12:53:41.221000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 251/500] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:41 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:53:41.981510 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-04f6be29-990d-4971-a4ff-bce7969c0cfb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:41.982131 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-04f6be29-990d-4971-a4ff-bce7969c0cfb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:41.989700 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-04f6be29-990d-4971-a4ff-bce7969c0cfb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:41.990206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-04f6be29-990d-4971-a4ff-bce7969c0cfb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:41.990650 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-04f6be29-990d-4971-a4ff-bce7969c0cfb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:41.991642 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-04f6be29-990d-4971-a4ff-bce7969c0cfb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:41.992104 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-04f6be29-990d-4971-a4ff-bce7969c0cfb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:41.992584 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-04f6be29-990d-4971-a4ff-bce7969c0cfb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:42.054700 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-04f6be29-990d-4971-a4ff-bce7969c0cfb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:42.062437 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-04f6be29-990d-4971-a4ff-bce7969c0cfb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1187 microversion: 2.1 time: 0.084806 Oct 03 12:53:42.063018 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 250/501] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:41 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:53:42.247904 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a9eea0ea-9318-4d19-91bb-23bd06c78612 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:42.249262 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a9eea0ea-9318-4d19-91bb-23bd06c78612 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:42.256732 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a9eea0ea-9318-4d19-91bb-23bd06c78612 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:42.262791 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a9eea0ea-9318-4d19-91bb-23bd06c78612 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:42.262791 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a9eea0ea-9318-4d19-91bb-23bd06c78612 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:42.262791 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a9eea0ea-9318-4d19-91bb-23bd06c78612 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:42.262791 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a9eea0ea-9318-4d19-91bb-23bd06c78612 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:42.263219 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a9eea0ea-9318-4d19-91bb-23bd06c78612 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:42.397572 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-a9eea0ea-9318-4d19-91bb-23bd06c78612 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:42.406995 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a9eea0ea-9318-4d19-91bb-23bd06c78612 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.163805 Oct 03 12:53:42.407621 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 252/502] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:42 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:43.088355 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4a0c2897-3599-4d7f-aa00-5ea760e3c7c3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:43.089327 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-4a0c2897-3599-4d7f-aa00-5ea760e3c7c3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:43.095925 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4a0c2897-3599-4d7f-aa00-5ea760e3c7c3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:43.096423 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4a0c2897-3599-4d7f-aa00-5ea760e3c7c3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:43.097608 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4a0c2897-3599-4d7f-aa00-5ea760e3c7c3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:43.097608 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4a0c2897-3599-4d7f-aa00-5ea760e3c7c3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:43.098696 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4a0c2897-3599-4d7f-aa00-5ea760e3c7c3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:43.099300 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4a0c2897-3599-4d7f-aa00-5ea760e3c7c3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:43.247580 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4a0c2897-3599-4d7f-aa00-5ea760e3c7c3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:43.260052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-4a0c2897-3599-4d7f-aa00-5ea760e3c7c3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1273 microversion: 2.1 time: 0.175270 Oct 03 12:53:43.262622 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 251/503] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:43 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1273 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:43.431390 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-32f86b63-d3a0-49ec-81a8-d9533cdc5bc5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:43.434602 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-32f86b63-d3a0-49ec-81a8-d9533cdc5bc5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:43.439612 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-32f86b63-d3a0-49ec-81a8-d9533cdc5bc5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:43.440174 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-32f86b63-d3a0-49ec-81a8-d9533cdc5bc5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:43.440677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-32f86b63-d3a0-49ec-81a8-d9533cdc5bc5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:43.441484 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-32f86b63-d3a0-49ec-81a8-d9533cdc5bc5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:43.442705 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-32f86b63-d3a0-49ec-81a8-d9533cdc5bc5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:43.443330 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-32f86b63-d3a0-49ec-81a8-d9533cdc5bc5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:43.577893 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-32f86b63-d3a0-49ec-81a8-d9533cdc5bc5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:43.587326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-32f86b63-d3a0-49ec-81a8-d9533cdc5bc5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.160246 Oct 03 12:53:43.587905 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 253/504] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:43 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:43.964751 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-14fb9ae2-3a84-4996-b7bb-51068e1ba0a4 req-68413105-32f8-42b7-81df-cd1edc29dfa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a54301-d1b8-4060-b712-8d707bcfbef5", "tag": "7deec46d-97bb-4a3f-a77b-11832cd2ffe1"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:53:43.975296 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-14fb9ae2-3a84-4996-b7bb-51068e1ba0a4 req-68413105-32f8-42b7-81df-cd1edc29dfa8 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:43.975876 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-14fb9ae2-3a84-4996-b7bb-51068e1ba0a4 req-68413105-32f8-42b7-81df-cd1edc29dfa8 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:43.976317 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-14fb9ae2-3a84-4996-b7bb-51068e1ba0a4 req-68413105-32f8-42b7-81df-cd1edc29dfa8 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:43.987419 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-14fb9ae2-3a84-4996-b7bb-51068e1ba0a4 req-68413105-32f8-42b7-81df-cd1edc29dfa8 service nova] Creating event network-changed:7deec46d-97bb-4a3f-a77b-11832cd2ffe1 for instance e3a54301-d1b8-4060-b712-8d707bcfbef5 on hv-cinder-84456 Oct 03 12:53:43.993239 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-14fb9ae2-3a84-4996-b7bb-51068e1ba0a4 req-68413105-32f8-42b7-81df-cd1edc29dfa8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032262 Oct 03 12:53:43.993889 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 252/505] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:53:44.284455 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-24098224-435b-4552-a5bb-0f587bf98f3e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:44.285064 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-24098224-435b-4552-a5bb-0f587bf98f3e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:44.291938 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24098224-435b-4552-a5bb-0f587bf98f3e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:44.292423 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24098224-435b-4552-a5bb-0f587bf98f3e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:44.292855 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24098224-435b-4552-a5bb-0f587bf98f3e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:44.293636 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24098224-435b-4552-a5bb-0f587bf98f3e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:44.294089 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24098224-435b-4552-a5bb-0f587bf98f3e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:44.294951 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24098224-435b-4552-a5bb-0f587bf98f3e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:44.434663 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-24098224-435b-4552-a5bb-0f587bf98f3e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:44.443286 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-24098224-435b-4552-a5bb-0f587bf98f3e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1261 microversion: 2.1 time: 0.163262 Oct 03 12:53:44.443885 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 254/506] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:44 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:44.612035 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e04b6798-3637-4f68-9f25-bd30487fabad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:44.612877 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e04b6798-3637-4f68-9f25-bd30487fabad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:44.617014 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=62 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:44.624302 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e04b6798-3637-4f68-9f25-bd30487fabad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:44.628338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e04b6798-3637-4f68-9f25-bd30487fabad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:44.628338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e04b6798-3637-4f68-9f25-bd30487fabad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:44.628338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e04b6798-3637-4f68-9f25-bd30487fabad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:44.628338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e04b6798-3637-4f68-9f25-bd30487fabad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:44.628711 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e04b6798-3637-4f68-9f25-bd30487fabad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:44.759421 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e04b6798-3637-4f68-9f25-bd30487fabad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:44.767626 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e04b6798-3637-4f68-9f25-bd30487fabad tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.160265 Oct 03 12:53:44.768332 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 253/507] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:44 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:45.466139 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c5a37267-3cdd-4c3c-b41f-bf7b2de6208c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:45.469087 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-c5a37267-3cdd-4c3c-b41f-bf7b2de6208c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:45.474248 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c5a37267-3cdd-4c3c-b41f-bf7b2de6208c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:45.474757 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c5a37267-3cdd-4c3c-b41f-bf7b2de6208c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:45.475188 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c5a37267-3cdd-4c3c-b41f-bf7b2de6208c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:45.476231 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c5a37267-3cdd-4c3c-b41f-bf7b2de6208c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:45.476687 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c5a37267-3cdd-4c3c-b41f-bf7b2de6208c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:45.477113 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c5a37267-3cdd-4c3c-b41f-bf7b2de6208c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:45.610869 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c5a37267-3cdd-4c3c-b41f-bf7b2de6208c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:45.618613 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c5a37267-3cdd-4c3c-b41f-bf7b2de6208c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1261 microversion: 2.1 time: 0.156301 Oct 03 12:53:45.619181 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 255/508] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:45 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:45.791185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-98f51e9e-4ceb-4706-82fb-8497619aec1d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:45.791867 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-98f51e9e-4ceb-4706-82fb-8497619aec1d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:45.798351 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-98f51e9e-4ceb-4706-82fb-8497619aec1d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:45.798847 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-98f51e9e-4ceb-4706-82fb-8497619aec1d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:45.799285 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-98f51e9e-4ceb-4706-82fb-8497619aec1d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:45.800002 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-98f51e9e-4ceb-4706-82fb-8497619aec1d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:45.800458 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-98f51e9e-4ceb-4706-82fb-8497619aec1d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:45.800972 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-98f51e9e-4ceb-4706-82fb-8497619aec1d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:45.929588 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-98f51e9e-4ceb-4706-82fb-8497619aec1d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:45.937622 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-98f51e9e-4ceb-4706-82fb-8497619aec1d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.150242 Oct 03 12:53:45.938184 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 254/509] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:45 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:46.640711 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3b620de5-683a-4cec-ae18-b75d71833411 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:46.641331 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-3b620de5-683a-4cec-ae18-b75d71833411 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:46.648624 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3b620de5-683a-4cec-ae18-b75d71833411 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:46.649121 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3b620de5-683a-4cec-ae18-b75d71833411 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:46.649556 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3b620de5-683a-4cec-ae18-b75d71833411 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:46.650251 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3b620de5-683a-4cec-ae18-b75d71833411 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:46.650708 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3b620de5-683a-4cec-ae18-b75d71833411 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:46.651133 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3b620de5-683a-4cec-ae18-b75d71833411 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:46.784280 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3b620de5-683a-4cec-ae18-b75d71833411 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:46.792512 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-3b620de5-683a-4cec-ae18-b75d71833411 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1261 microversion: 2.1 time: 0.155550 Oct 03 12:53:46.793096 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 256/510] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:46 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:46.960849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-38621525-e727-4e99-9093-febd269a9ebe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:46.961461 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-38621525-e727-4e99-9093-febd269a9ebe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:46.967850 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38621525-e727-4e99-9093-febd269a9ebe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:46.968423 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38621525-e727-4e99-9093-febd269a9ebe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:46.968861 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38621525-e727-4e99-9093-febd269a9ebe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:46.969549 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38621525-e727-4e99-9093-febd269a9ebe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:46.969999 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38621525-e727-4e99-9093-febd269a9ebe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:46.970422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38621525-e727-4e99-9093-febd269a9ebe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:47.107623 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-38621525-e727-4e99-9093-febd269a9ebe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:47.116613 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-38621525-e727-4e99-9093-febd269a9ebe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.159357 Oct 03 12:53:47.117118 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 255/511] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:46 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:47.814890 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-af1bfd3b-6548-473a-9e19-ded0460f6cc4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:47.815543 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-af1bfd3b-6548-473a-9e19-ded0460f6cc4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:47.817923 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:47.822904 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-af1bfd3b-6548-473a-9e19-ded0460f6cc4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:47.827030 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-af1bfd3b-6548-473a-9e19-ded0460f6cc4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:47.827030 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-af1bfd3b-6548-473a-9e19-ded0460f6cc4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:47.827030 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-af1bfd3b-6548-473a-9e19-ded0460f6cc4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:47.827030 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-af1bfd3b-6548-473a-9e19-ded0460f6cc4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:47.827648 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-af1bfd3b-6548-473a-9e19-ded0460f6cc4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:47.983522 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-af1bfd3b-6548-473a-9e19-ded0460f6cc4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:47.991742 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-af1bfd3b-6548-473a-9e19-ded0460f6cc4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1261 microversion: 2.1 time: 0.180425 Oct 03 12:53:47.992324 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 257/512] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:47 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:48.139069 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-85b93c9d-57c7-4d07-8abe-6e9f954ec3dc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:48.139711 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-85b93c9d-57c7-4d07-8abe-6e9f954ec3dc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:48.147041 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-85b93c9d-57c7-4d07-8abe-6e9f954ec3dc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:48.147976 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-85b93c9d-57c7-4d07-8abe-6e9f954ec3dc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:48.148481 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-85b93c9d-57c7-4d07-8abe-6e9f954ec3dc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:48.149160 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-85b93c9d-57c7-4d07-8abe-6e9f954ec3dc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:48.149614 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-85b93c9d-57c7-4d07-8abe-6e9f954ec3dc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:48.150039 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-85b93c9d-57c7-4d07-8abe-6e9f954ec3dc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:48.285901 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-85b93c9d-57c7-4d07-8abe-6e9f954ec3dc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:48.294282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-85b93c9d-57c7-4d07-8abe-6e9f954ec3dc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1736 microversion: 2.1 time: 0.159140 Oct 03 12:53:48.294864 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 256/513] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:48 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:49.014224 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-48f33901-d217-4153-87ed-9277e73e4d53 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:49.014965 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-48f33901-d217-4153-87ed-9277e73e4d53 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:49.021656 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-48f33901-d217-4153-87ed-9277e73e4d53 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:49.022177 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-48f33901-d217-4153-87ed-9277e73e4d53 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:49.023392 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-48f33901-d217-4153-87ed-9277e73e4d53 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:49.024129 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-48f33901-d217-4153-87ed-9277e73e4d53 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:49.024611 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-48f33901-d217-4153-87ed-9277e73e4d53 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:49.025563 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-48f33901-d217-4153-87ed-9277e73e4d53 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:49.162259 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=2 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:49.181949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=6 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:49.318068 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-122ef008-f532-4f0f-b652-b18c12b5f0bf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:49.318654 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-122ef008-f532-4f0f-b652-b18c12b5f0bf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:49.325341 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-122ef008-f532-4f0f-b652-b18c12b5f0bf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:49.326157 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-122ef008-f532-4f0f-b652-b18c12b5f0bf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:49.326587 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-122ef008-f532-4f0f-b652-b18c12b5f0bf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:49.328088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-122ef008-f532-4f0f-b652-b18c12b5f0bf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:49.328088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-122ef008-f532-4f0f-b652-b18c12b5f0bf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:49.328308 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-122ef008-f532-4f0f-b652-b18c12b5f0bf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:49.418173 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-48f33901-d217-4153-87ed-9277e73e4d53 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:49.432700 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-48f33901-d217-4153-87ed-9277e73e4d53 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1261 microversion: 2.1 time: 0.415290 Oct 03 12:53:49.432700 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 258/514] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:49 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1261 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:49.480665 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-122ef008-f532-4f0f-b652-b18c12b5f0bf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:49.490232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-122ef008-f532-4f0f-b652-b18c12b5f0bf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1716 microversion: 2.1 time: 0.176380 Oct 03 12:53:49.490806 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 257/515] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:49 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1716 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:53:49.600509 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-cb46cc31-1a3b-4dd8-8beb-e63b8d6a1ffe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:49.601028 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-cb46cc31-1a3b-4dd8-8beb-e63b8d6a1ffe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:49.606954 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb46cc31-1a3b-4dd8-8beb-e63b8d6a1ffe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:49.607465 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb46cc31-1a3b-4dd8-8beb-e63b8d6a1ffe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:49.607899 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb46cc31-1a3b-4dd8-8beb-e63b8d6a1ffe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:49.608581 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb46cc31-1a3b-4dd8-8beb-e63b8d6a1ffe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:49.609032 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb46cc31-1a3b-4dd8-8beb-e63b8d6a1ffe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:49.609451 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb46cc31-1a3b-4dd8-8beb-e63b8d6a1ffe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:49.733417 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-cb46cc31-1a3b-4dd8-8beb-e63b8d6a1ffe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] HTTP exception thrown: Cannot 'detach_volume' instance 85d3f4ae-60a5-4463-9a02-00d846d22289 while it is in vm_state rescued Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-cb46cc31-1a3b-4dd8-8beb-e63b8d6a1ffe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Request method failure captured: Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: DELETE /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-volume_attachments/04dc6a57-1ed6-4c6e-a423-b0ad9c899e11 HTTP/1.1 Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtpg_jSSVskjPk1vj2hB6kFIFqzmNhwYwmbqVtDtVEm_DCGqJp2bI-HTYHdXoVGxmBUvfojEda8t7ahZxu3oZUxrCi0M81LTwRQ1oj9rh78tD7KDuQLShxe9wj1rzH1fQcVA6c-lh1vZH84HHzjmTQfelEBPR3ibYOhBaZo555opZQM Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: 3f2b18d217d14d39886718cf209eb576 Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103094266 Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 12:53:49.735000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 12:53:49.736581 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f2b18d217d14d39886718cf209eb576"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f2b18d217d14d39886718cf209eb576"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f2b18d217d14d39886718cf209eb576"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f2b18d217d14d39886718cf209eb576"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:53:49.736581 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103094266 Oct 03 12:53:49.736581 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: 3f2b18d217d14d39886718cf209eb576 Oct 03 12:53:49.736581 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103094266 Oct 03 12:53:49.736581 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-ServerRescueNegativeTestJSON-1103094266-project Oct 03 12:53:49.736581 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 12:53:49.736581 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 12:53:49.736581 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: ad5654cfa65f4cfa9e68832b9cd3d129 Oct 03 12:53:49.736581 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103094266-project Oct 03 12:53:49.736581 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 12:53:49.736581 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Cannot 'detach_volume' instance 85d3f4ae-60a5-4463-9a02-00d846d22289 while it is in vm_state rescued Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'server_id': '85d3f4ae-60a5-4463-9a02-00d846d22289', 'id': '04dc6a57-1ed6-4c6e-a423-b0ad9c899e11'} Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 85d3f4ae-60a5-4463-9a02-00d846d22289 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:53:49.737416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:53:49.739361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 03 12:53:49.739361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 12:53:49.739361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 12:53:49.739361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 12:53:49.739361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 85d3f4ae-60a5-4463-9a02-00d846d22289 while it is in vm_state rescued Oct 03 12:53:49.739361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:53:49.739361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:53:49.739361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:53:49.739361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:53:49.739361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:53:49.739361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:53:49.739361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:53:49.739361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:53:49.739361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 85d3f4ae-60a5-4463-9a02-00d846d22289 while it is in vm_state rescued Oct 03 12:53:49.739361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:53:49.739361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-cb46cc31-1a3b-4dd8-8beb-e63b8d6a1ffe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Returning 409 to user: Cannot 'detach_volume' instance 85d3f4ae-60a5-4463-9a02-00d846d22289 while it is in vm_state rescued {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:53:49.740543 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-cb46cc31-1a3b-4dd8-8beb-e63b8d6a1ffe tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "DELETE /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-volume_attachments/04dc6a57-1ed6-4c6e-a423-b0ad9c899e11" status: 409 len: 152 microversion: 2.1 time: 0.140720 Oct 03 12:53:49.740543 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 259/516] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 12:53:49 2022] DELETE /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-volume_attachments/04dc6a57-1ed6-4c6e-a423-b0ad9c899e11 => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 12:53:49.746235 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7d6dba6b-d115-48dd-9de7-950469ce14cf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:53:49.746780 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-7d6dba6b-d115-48dd-9de7-950469ce14cf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:49.752695 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d6dba6b-d115-48dd-9de7-950469ce14cf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:49.753181 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d6dba6b-d115-48dd-9de7-950469ce14cf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:49.753624 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d6dba6b-d115-48dd-9de7-950469ce14cf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:49.754821 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d6dba6b-d115-48dd-9de7-950469ce14cf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:49.755284 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d6dba6b-d115-48dd-9de7-950469ce14cf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:49.755754 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d6dba6b-d115-48dd-9de7-950469ce14cf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:49.845755 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:49.977640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-7d6dba6b-d115-48dd-9de7-950469ce14cf tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "POST /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/action" status: 202 len: 0 microversion: 2.1 time: 0.234990 Oct 03 12:53:49.978433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 258/517] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 12:53:49 2022] POST /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:53:49.986639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ab3c3c0e-4e09-4a3b-bcde-fcb261cd73c2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:49.987391 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ab3c3c0e-4e09-4a3b-bcde-fcb261cd73c2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:49.995174 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ab3c3c0e-4e09-4a3b-bcde-fcb261cd73c2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:49.996062 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ab3c3c0e-4e09-4a3b-bcde-fcb261cd73c2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:49.996174 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ab3c3c0e-4e09-4a3b-bcde-fcb261cd73c2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:49.996869 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ab3c3c0e-4e09-4a3b-bcde-fcb261cd73c2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:49.997322 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ab3c3c0e-4e09-4a3b-bcde-fcb261cd73c2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:49.997745 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ab3c3c0e-4e09-4a3b-bcde-fcb261cd73c2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:50.126330 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-ab3c3c0e-4e09-4a3b-bcde-fcb261cd73c2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:50.135337 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ab3c3c0e-4e09-4a3b-bcde-fcb261cd73c2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1724 microversion: 2.1 time: 0.152598 Oct 03 12:53:50.135901 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 260/518] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:49 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:50.450962 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c07ea854-ed22-4d52-9301-d35b706c56b4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:50.451688 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c07ea854-ed22-4d52-9301-d35b706c56b4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:50.458040 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c07ea854-ed22-4d52-9301-d35b706c56b4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:50.458529 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c07ea854-ed22-4d52-9301-d35b706c56b4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:50.458966 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c07ea854-ed22-4d52-9301-d35b706c56b4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:50.459693 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c07ea854-ed22-4d52-9301-d35b706c56b4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:50.460148 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c07ea854-ed22-4d52-9301-d35b706c56b4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:50.460605 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c07ea854-ed22-4d52-9301-d35b706c56b4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:50.591044 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c07ea854-ed22-4d52-9301-d35b706c56b4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:50.599579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c07ea854-ed22-4d52-9301-d35b706c56b4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1261 microversion: 2.1 time: 0.153282 Oct 03 12:53:50.600167 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 259/519] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:50 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:51.158022 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-663bbd9d-0661-42f8-8dc3-0f57ebd58d17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:51.158641 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-663bbd9d-0661-42f8-8dc3-0f57ebd58d17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:51.165646 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-663bbd9d-0661-42f8-8dc3-0f57ebd58d17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:51.166132 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-663bbd9d-0661-42f8-8dc3-0f57ebd58d17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:51.166568 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-663bbd9d-0661-42f8-8dc3-0f57ebd58d17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:51.167265 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-663bbd9d-0661-42f8-8dc3-0f57ebd58d17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:51.167772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-663bbd9d-0661-42f8-8dc3-0f57ebd58d17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:51.168200 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-663bbd9d-0661-42f8-8dc3-0f57ebd58d17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:51.300363 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-663bbd9d-0661-42f8-8dc3-0f57ebd58d17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:51.309203 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-663bbd9d-0661-42f8-8dc3-0f57ebd58d17 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1724 microversion: 2.1 time: 0.155011 Oct 03 12:53:51.309775 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 261/520] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:51 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:51.622483 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-53a893e9-7b7a-45f2-a108-e21c48af9575 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:51.623723 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-53a893e9-7b7a-45f2-a108-e21c48af9575 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:51.631430 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53a893e9-7b7a-45f2-a108-e21c48af9575 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:51.631929 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53a893e9-7b7a-45f2-a108-e21c48af9575 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:51.632374 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53a893e9-7b7a-45f2-a108-e21c48af9575 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:51.633322 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53a893e9-7b7a-45f2-a108-e21c48af9575 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:51.633523 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53a893e9-7b7a-45f2-a108-e21c48af9575 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:51.633954 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53a893e9-7b7a-45f2-a108-e21c48af9575 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:51.762418 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-53a893e9-7b7a-45f2-a108-e21c48af9575 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:51.770020 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-53a893e9-7b7a-45f2-a108-e21c48af9575 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1261 microversion: 2.1 time: 0.151372 Oct 03 12:53:51.770582 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 260/521] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:51 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:52.332626 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c2a940c6-9a70-4f50-a8f9-e3e89d154920 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:52.333293 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-c2a940c6-9a70-4f50-a8f9-e3e89d154920 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:52.339735 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c2a940c6-9a70-4f50-a8f9-e3e89d154920 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:52.340217 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c2a940c6-9a70-4f50-a8f9-e3e89d154920 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:52.340646 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c2a940c6-9a70-4f50-a8f9-e3e89d154920 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:52.341337 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c2a940c6-9a70-4f50-a8f9-e3e89d154920 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:52.341788 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c2a940c6-9a70-4f50-a8f9-e3e89d154920 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:52.342208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c2a940c6-9a70-4f50-a8f9-e3e89d154920 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:52.473750 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c2a940c6-9a70-4f50-a8f9-e3e89d154920 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:52.481847 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c2a940c6-9a70-4f50-a8f9-e3e89d154920 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1724 microversion: 2.1 time: 0.153398 Oct 03 12:53:52.482409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 262/522] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:52 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:52.792568 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e4be4352-4f91-4f21-90a1-d58c970946aa tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:52.793181 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e4be4352-4f91-4f21-90a1-d58c970946aa tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:52.799616 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e4be4352-4f91-4f21-90a1-d58c970946aa tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:52.800098 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e4be4352-4f91-4f21-90a1-d58c970946aa tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:52.801167 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e4be4352-4f91-4f21-90a1-d58c970946aa tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:52.801913 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e4be4352-4f91-4f21-90a1-d58c970946aa tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:52.802367 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e4be4352-4f91-4f21-90a1-d58c970946aa tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:52.802787 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e4be4352-4f91-4f21-90a1-d58c970946aa tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:52.934660 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e4be4352-4f91-4f21-90a1-d58c970946aa tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:52.942779 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e4be4352-4f91-4f21-90a1-d58c970946aa tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1261 microversion: 2.1 time: 0.153886 Oct 03 12:53:52.943388 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 261/523] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:52 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:53.506793 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-12d300bd-a963-40e5-bff7-e574e8fb0f61 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:53.508452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-12d300bd-a963-40e5-bff7-e574e8fb0f61 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:53.516129 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-12d300bd-a963-40e5-bff7-e574e8fb0f61 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:53.516626 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-12d300bd-a963-40e5-bff7-e574e8fb0f61 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:53.517066 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-12d300bd-a963-40e5-bff7-e574e8fb0f61 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:53.517771 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-12d300bd-a963-40e5-bff7-e574e8fb0f61 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:53.518252 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-12d300bd-a963-40e5-bff7-e574e8fb0f61 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:53.518679 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-12d300bd-a963-40e5-bff7-e574e8fb0f61 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:53.534551 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=100 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:53.650748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-12d300bd-a963-40e5-bff7-e574e8fb0f61 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:53.658889 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-12d300bd-a963-40e5-bff7-e574e8fb0f61 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1724 microversion: 2.1 time: 0.156837 Oct 03 12:53:53.659476 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 263/524] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:53 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:53.965789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-2b812712-a66a-400c-bd46-5a7c4373844b tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:53.966332 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-2b812712-a66a-400c-bd46-5a7c4373844b tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:53.973386 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2b812712-a66a-400c-bd46-5a7c4373844b tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:53.973875 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2b812712-a66a-400c-bd46-5a7c4373844b tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:53.974312 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2b812712-a66a-400c-bd46-5a7c4373844b tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:53.974997 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2b812712-a66a-400c-bd46-5a7c4373844b tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:53.975482 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2b812712-a66a-400c-bd46-5a7c4373844b tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:53.975908 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2b812712-a66a-400c-bd46-5a7c4373844b tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:54.111924 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-2b812712-a66a-400c-bd46-5a7c4373844b tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:54.119719 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-2b812712-a66a-400c-bd46-5a7c4373844b tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1261 microversion: 2.1 time: 0.157798 Oct 03 12:53:54.120287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 262/525] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:53 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:54.686196 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bf54c5bb-5547-4fcf-b839-5c29920b625d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:54.686811 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-bf54c5bb-5547-4fcf-b839-5c29920b625d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:54.693705 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf54c5bb-5547-4fcf-b839-5c29920b625d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:54.694187 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf54c5bb-5547-4fcf-b839-5c29920b625d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:54.694619 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf54c5bb-5547-4fcf-b839-5c29920b625d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:54.695305 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf54c5bb-5547-4fcf-b839-5c29920b625d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:54.695798 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf54c5bb-5547-4fcf-b839-5c29920b625d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:54.696227 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bf54c5bb-5547-4fcf-b839-5c29920b625d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:54.829671 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-bf54c5bb-5547-4fcf-b839-5c29920b625d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:54.839201 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-bf54c5bb-5547-4fcf-b839-5c29920b625d tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1730 microversion: 2.1 time: 0.157489 Oct 03 12:53:54.839806 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 264/526] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:54 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:54.861949 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-727518c6-70c1-4a55-addb-018e33a7301e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:54.862518 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-727518c6-70c1-4a55-addb-018e33a7301e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:54.868907 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-727518c6-70c1-4a55-addb-018e33a7301e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:54.869400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-727518c6-70c1-4a55-addb-018e33a7301e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:54.869847 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-727518c6-70c1-4a55-addb-018e33a7301e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:54.870556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-727518c6-70c1-4a55-addb-018e33a7301e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:54.871014 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-727518c6-70c1-4a55-addb-018e33a7301e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:54.871497 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-727518c6-70c1-4a55-addb-018e33a7301e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:54.889071 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:54.937672 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-d26424c6-c073-4934-ac48-0f660d89fa57 req-787ae0b6-06b6-40e0-be58-437d68725230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a54301-d1b8-4060-b712-8d707bcfbef5", "name": "network-vif-plugged", "status": "completed", "tag": "7deec46d-97bb-4a3f-a77b-11832cd2ffe1"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:53:54.946960 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-d26424c6-c073-4934-ac48-0f660d89fa57 req-787ae0b6-06b6-40e0-be58-437d68725230 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:54.947463 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-d26424c6-c073-4934-ac48-0f660d89fa57 req-787ae0b6-06b6-40e0-be58-437d68725230 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:54.947896 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-d26424c6-c073-4934-ac48-0f660d89fa57 req-787ae0b6-06b6-40e0-be58-437d68725230 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:54.955476 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-727518c6-70c1-4a55-addb-018e33a7301e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097340 Oct 03 12:53:54.956096 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 263/527] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Oct 3 12:53:54 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:53:54.959890 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-d26424c6-c073-4934-ac48-0f660d89fa57 req-787ae0b6-06b6-40e0-be58-437d68725230 service nova] Creating event network-vif-plugged:7deec46d-97bb-4a3f-a77b-11832cd2ffe1 for instance e3a54301-d1b8-4060-b712-8d707bcfbef5 on hv-cinder-84456 Oct 03 12:53:54.966505 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-d26424c6-c073-4934-ac48-0f660d89fa57 req-787ae0b6-06b6-40e0-be58-437d68725230 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032505 Oct 03 12:53:54.967726 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 265/528] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:53:55.143536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3bbbfbbf-67f2-4f7f-892d-cd6ed90ebc17 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:55.144302 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3bbbfbbf-67f2-4f7f-892d-cd6ed90ebc17 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:55.151217 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3bbbfbbf-67f2-4f7f-892d-cd6ed90ebc17 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:55.151830 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3bbbfbbf-67f2-4f7f-892d-cd6ed90ebc17 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:55.152224 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3bbbfbbf-67f2-4f7f-892d-cd6ed90ebc17 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:55.152944 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3bbbfbbf-67f2-4f7f-892d-cd6ed90ebc17 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:55.153405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3bbbfbbf-67f2-4f7f-892d-cd6ed90ebc17 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:55.153836 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3bbbfbbf-67f2-4f7f-892d-cd6ed90ebc17 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:55.304554 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3bbbfbbf-67f2-4f7f-892d-cd6ed90ebc17 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:55.312259 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3bbbfbbf-67f2-4f7f-892d-cd6ed90ebc17 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1261 microversion: 2.1 time: 0.173110 Oct 03 12:53:55.312828 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 264/529] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:55 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:56.201325 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-f601a5d1-b0ee-428a-9d55-47db4bd332fe req-bea0edcb-9e04-48c0-872c-656eaeab534f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d3f4ae-60a5-4463-9a02-00d846d22289", "tag": "99141c24-9fad-4cf8-9d13-c4d90e5ddd88"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:53:56.211908 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-f601a5d1-b0ee-428a-9d55-47db4bd332fe req-bea0edcb-9e04-48c0-872c-656eaeab534f service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:56.212469 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-f601a5d1-b0ee-428a-9d55-47db4bd332fe req-bea0edcb-9e04-48c0-872c-656eaeab534f service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:56.212958 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-f601a5d1-b0ee-428a-9d55-47db4bd332fe req-bea0edcb-9e04-48c0-872c-656eaeab534f service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:56.224501 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-f601a5d1-b0ee-428a-9d55-47db4bd332fe req-bea0edcb-9e04-48c0-872c-656eaeab534f service nova] Creating event network-changed:99141c24-9fad-4cf8-9d13-c4d90e5ddd88 for instance 85d3f4ae-60a5-4463-9a02-00d846d22289 on hv-cinder-84456 Oct 03 12:53:56.229567 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-f601a5d1-b0ee-428a-9d55-47db4bd332fe req-bea0edcb-9e04-48c0-872c-656eaeab534f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032685 Oct 03 12:53:56.230147 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 266/530] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:53:56.334840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e10372a5-f2d8-4775-9c1d-c3916d255d91 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:56.335572 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e10372a5-f2d8-4775-9c1d-c3916d255d91 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:56.341843 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e10372a5-f2d8-4775-9c1d-c3916d255d91 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:56.342337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e10372a5-f2d8-4775-9c1d-c3916d255d91 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:56.342779 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e10372a5-f2d8-4775-9c1d-c3916d255d91 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:56.343519 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e10372a5-f2d8-4775-9c1d-c3916d255d91 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:56.343978 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e10372a5-f2d8-4775-9c1d-c3916d255d91 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:56.344408 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e10372a5-f2d8-4775-9c1d-c3916d255d91 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:56.481443 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e10372a5-f2d8-4775-9c1d-c3916d255d91 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:56.490422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e10372a5-f2d8-4775-9c1d-c3916d255d91 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1261 microversion: 2.1 time: 0.159537 Oct 03 12:53:56.491545 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 265/531] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:56 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:57.519830 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e0f76905-54f7-4e6a-b176-1eb3104b01d3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:57.521216 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-e0f76905-54f7-4e6a-b176-1eb3104b01d3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:57.528791 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e0f76905-54f7-4e6a-b176-1eb3104b01d3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:57.529334 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e0f76905-54f7-4e6a-b176-1eb3104b01d3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:57.529765 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e0f76905-54f7-4e6a-b176-1eb3104b01d3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:57.540525 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e0f76905-54f7-4e6a-b176-1eb3104b01d3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:57.540525 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e0f76905-54f7-4e6a-b176-1eb3104b01d3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:57.540525 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e0f76905-54f7-4e6a-b176-1eb3104b01d3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:57.668210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e0f76905-54f7-4e6a-b176-1eb3104b01d3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:57.676432 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e0f76905-54f7-4e6a-b176-1eb3104b01d3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1445 microversion: 2.1 time: 0.162101 Oct 03 12:53:57.676997 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 267/532] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:57 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1445 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:57.698461 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-08688c89-2d49-4fcd-ae3b-80d3caa73357 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:53:57.703724 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-08688c89-2d49-4fcd-ae3b-80d3caa73357 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:53:57.705233 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-08688c89-2d49-4fcd-ae3b-80d3caa73357 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:57.705722 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-08688c89-2d49-4fcd-ae3b-80d3caa73357 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:57.706161 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-08688c89-2d49-4fcd-ae3b-80d3caa73357 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:57.706883 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-08688c89-2d49-4fcd-ae3b-80d3caa73357 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:57.707562 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-08688c89-2d49-4fcd-ae3b-80d3caa73357 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:57.708000 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-08688c89-2d49-4fcd-ae3b-80d3caa73357 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:57.841048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-08688c89-2d49-4fcd-ae3b-80d3caa73357 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:53:57.849867 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-08688c89-2d49-4fcd-ae3b-80d3caa73357 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1445 microversion: 2.1 time: 0.155182 Oct 03 12:53:57.850441 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 266/533] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:53:57 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1445 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:53:58.244970 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-e48589ea-c118-4f63-905d-d2f002c6461a req-4c5b8453-87ad-44a1-889f-0e499ae513a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d3f4ae-60a5-4463-9a02-00d846d22289", "tag": "99141c24-9fad-4cf8-9d13-c4d90e5ddd88"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:53:58.254500 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-e48589ea-c118-4f63-905d-d2f002c6461a req-4c5b8453-87ad-44a1-889f-0e499ae513a4 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:53:58.255548 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-e48589ea-c118-4f63-905d-d2f002c6461a req-4c5b8453-87ad-44a1-889f-0e499ae513a4 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:53:58.255983 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-e48589ea-c118-4f63-905d-d2f002c6461a req-4c5b8453-87ad-44a1-889f-0e499ae513a4 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:53:58.267152 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-e48589ea-c118-4f63-905d-d2f002c6461a req-4c5b8453-87ad-44a1-889f-0e499ae513a4 service nova] Creating event network-changed:99141c24-9fad-4cf8-9d13-c4d90e5ddd88 for instance 85d3f4ae-60a5-4463-9a02-00d846d22289 on hv-cinder-84456 Oct 03 12:53:58.272530 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-e48589ea-c118-4f63-905d-d2f002c6461a req-4c5b8453-87ad-44a1-889f-0e499ae513a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031467 Oct 03 12:53:58.273119 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 268/534] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:54:00.440023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-4349e8fa-31a0-4053-a1e0-350cd5264042 req-bc5e6205-55f5-49be-b4fb-3e75366f08ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a54301-d1b8-4060-b712-8d707bcfbef5", "tag": "7deec46d-97bb-4a3f-a77b-11832cd2ffe1"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:54:00.449801 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-4349e8fa-31a0-4053-a1e0-350cd5264042 req-bc5e6205-55f5-49be-b4fb-3e75366f08ea service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:00.450508 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-4349e8fa-31a0-4053-a1e0-350cd5264042 req-bc5e6205-55f5-49be-b4fb-3e75366f08ea service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:00.451116 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-4349e8fa-31a0-4053-a1e0-350cd5264042 req-bc5e6205-55f5-49be-b4fb-3e75366f08ea service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:00.462888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-4349e8fa-31a0-4053-a1e0-350cd5264042 req-bc5e6205-55f5-49be-b4fb-3e75366f08ea service nova] Creating event network-changed:7deec46d-97bb-4a3f-a77b-11832cd2ffe1 for instance e3a54301-d1b8-4060-b712-8d707bcfbef5 on hv-cinder-84456 Oct 03 12:54:00.467854 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-4349e8fa-31a0-4053-a1e0-350cd5264042 req-bc5e6205-55f5-49be-b4fb-3e75366f08ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031496 Oct 03 12:54:00.468613 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 267/535] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:54:13.658650 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=23 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:13.659499 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=21 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:13.664245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ebe1bb71-978b-4197-9e4c-86c279a168a2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:13.664817 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ebe1bb71-978b-4197-9e4c-86c279a168a2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:13.670667 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ebe1bb71-978b-4197-9e4c-86c279a168a2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:13.680697 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ebe1bb71-978b-4197-9e4c-86c279a168a2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:13.680697 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ebe1bb71-978b-4197-9e4c-86c279a168a2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:13.680697 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ebe1bb71-978b-4197-9e4c-86c279a168a2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:13.680697 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ebe1bb71-978b-4197-9e4c-86c279a168a2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:13.681088 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ebe1bb71-978b-4197-9e4c-86c279a168a2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:13.701803 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ebe1bb71-978b-4197-9e4c-86c279a168a2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/os-volume_attachments/ccdd4e95-85ed-430f-ab7b-2316a95790da" status: 200 len: 194 microversion: 2.20 time: 0.044913 Oct 03 12:54:13.702370 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 269/536] 10.222.0.33 () {60 vars in 1454 bytes} [Mon Oct 3 12:54:13 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/os-volume_attachments/ccdd4e95-85ed-430f-ab7b-2316a95790da => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:54:13.772429 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=29 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:13.773166 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=20 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:13.777473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-9cbbc514-7ad1-45bf-93cd-084fdbc86f59 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:13.778060 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-9cbbc514-7ad1-45bf-93cd-084fdbc86f59 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:13.784110 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9cbbc514-7ad1-45bf-93cd-084fdbc86f59 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:13.788567 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9cbbc514-7ad1-45bf-93cd-084fdbc86f59 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:13.788567 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9cbbc514-7ad1-45bf-93cd-084fdbc86f59 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:13.788567 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9cbbc514-7ad1-45bf-93cd-084fdbc86f59 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:13.788567 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9cbbc514-7ad1-45bf-93cd-084fdbc86f59 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:13.788943 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9cbbc514-7ad1-45bf-93cd-084fdbc86f59 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:13.873896 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-9cbbc514-7ad1-45bf-93cd-084fdbc86f59 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lazy-loading 'services' on Instance uuid 54982238-81ba-4d23-b642-e3a37f778b4a {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:54:14.070159 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-9cbbc514-7ad1-45bf-93cd-084fdbc86f59 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "DELETE /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/os-volume_attachments/ccdd4e95-85ed-430f-ab7b-2316a95790da" status: 202 len: 0 microversion: 2.20 time: 0.299683 Oct 03 12:54:14.070743 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 268/537] 10.222.0.33 () {60 vars in 1457 bytes} [Mon Oct 3 12:54:13 2022] DELETE /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/os-volume_attachments/ccdd4e95-85ed-430f-ab7b-2316a95790da => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:54:14.080428 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8e96be7b-fcd9-4d5f-83ec-ec3eebb81c0f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:14.087569 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8e96be7b-fcd9-4d5f-83ec-ec3eebb81c0f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:14.089265 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e96be7b-fcd9-4d5f-83ec-ec3eebb81c0f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:14.089759 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e96be7b-fcd9-4d5f-83ec-ec3eebb81c0f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:14.090198 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e96be7b-fcd9-4d5f-83ec-ec3eebb81c0f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:14.090913 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e96be7b-fcd9-4d5f-83ec-ec3eebb81c0f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:14.091392 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e96be7b-fcd9-4d5f-83ec-ec3eebb81c0f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:14.091823 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e96be7b-fcd9-4d5f-83ec-ec3eebb81c0f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:14.126450 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-8e96be7b-fcd9-4d5f-83ec-ec3eebb81c0f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051157 Oct 03 12:54:14.127012 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 270/538] 10.222.0.33 () {60 vars in 1343 bytes} [Mon Oct 3 12:54:14 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:54:15.141170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d68a5813-c024-4e7c-b882-64be178f6b9d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:15.143545 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d68a5813-c024-4e7c-b882-64be178f6b9d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:15.149895 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d68a5813-c024-4e7c-b882-64be178f6b9d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:15.150390 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d68a5813-c024-4e7c-b882-64be178f6b9d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:15.150831 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d68a5813-c024-4e7c-b882-64be178f6b9d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:15.151553 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d68a5813-c024-4e7c-b882-64be178f6b9d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:15.152011 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d68a5813-c024-4e7c-b882-64be178f6b9d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:15.152440 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d68a5813-c024-4e7c-b882-64be178f6b9d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:15.183830 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d68a5813-c024-4e7c-b882-64be178f6b9d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047715 Oct 03 12:54:15.184382 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 269/539] 10.222.0.33 () {60 vars in 1343 bytes} [Mon Oct 3 12:54:15 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 12:54:16.197092 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8f3ad612-9b25-454a-97f5-caa37eb14ef9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:16.199453 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8f3ad612-9b25-454a-97f5-caa37eb14ef9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:16.206226 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f3ad612-9b25-454a-97f5-caa37eb14ef9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:16.206703 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f3ad612-9b25-454a-97f5-caa37eb14ef9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:16.207134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f3ad612-9b25-454a-97f5-caa37eb14ef9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:16.207852 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f3ad612-9b25-454a-97f5-caa37eb14ef9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:16.208300 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f3ad612-9b25-454a-97f5-caa37eb14ef9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:16.208718 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f3ad612-9b25-454a-97f5-caa37eb14ef9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:16.237047 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-8f3ad612-9b25-454a-97f5-caa37eb14ef9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045500 Oct 03 12:54:16.237608 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 271/540] 10.222.0.33 () {60 vars in 1343 bytes} [Mon Oct 3 12:54:16 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:16.300870 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-2147ccb0-793d-4399-8563-1680893cc579 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:16.301386 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-2147ccb0-793d-4399-8563-1680893cc579 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:16.308303 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2147ccb0-793d-4399-8563-1680893cc579 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:16.308793 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2147ccb0-793d-4399-8563-1680893cc579 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:16.309234 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2147ccb0-793d-4399-8563-1680893cc579 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:16.309928 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2147ccb0-793d-4399-8563-1680893cc579 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:16.310387 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2147ccb0-793d-4399-8563-1680893cc579 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:16.310813 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2147ccb0-793d-4399-8563-1680893cc579 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:16.337419 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-2147ccb0-793d-4399-8563-1680893cc579 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Going to try to terminate instance {{(pid=127542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:54:16.641644 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-2147ccb0-793d-4399-8563-1680893cc579 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "DELETE /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 204 len: 0 microversion: 2.20 time: 0.344409 Oct 03 12:54:16.642234 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 270/541] 10.222.0.33 () {60 vars in 1280 bytes} [Mon Oct 3 12:54:16 2022] DELETE /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 12:54:16.652869 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0a99eb62-301a-4f7b-b3ee-ec8c01c67e2a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:16.653857 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-0a99eb62-301a-4f7b-b3ee-ec8c01c67e2a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:16.659811 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a99eb62-301a-4f7b-b3ee-ec8c01c67e2a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:16.661926 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a99eb62-301a-4f7b-b3ee-ec8c01c67e2a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:16.661926 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a99eb62-301a-4f7b-b3ee-ec8c01c67e2a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:16.661926 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a99eb62-301a-4f7b-b3ee-ec8c01c67e2a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:16.661926 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a99eb62-301a-4f7b-b3ee-ec8c01c67e2a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:16.662465 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a99eb62-301a-4f7b-b3ee-ec8c01c67e2a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:16.795885 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0a99eb62-301a-4f7b-b3ee-ec8c01c67e2a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:16.804027 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0a99eb62-301a-4f7b-b3ee-ec8c01c67e2a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:16.805457 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0a99eb62-301a-4f7b-b3ee-ec8c01c67e2a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:16.806597 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0a99eb62-301a-4f7b-b3ee-ec8c01c67e2a tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1724 microversion: 2.20 time: 0.159989 Oct 03 12:54:16.807139 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 272/542] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:54:16 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:54:17.832501 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a1e508ec-1b37-4e1a-bb1c-a5e8f1f563ec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:17.833128 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a1e508ec-1b37-4e1a-bb1c-a5e8f1f563ec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:17.839955 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a1e508ec-1b37-4e1a-bb1c-a5e8f1f563ec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:17.840464 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a1e508ec-1b37-4e1a-bb1c-a5e8f1f563ec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:17.840888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a1e508ec-1b37-4e1a-bb1c-a5e8f1f563ec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:17.841592 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a1e508ec-1b37-4e1a-bb1c-a5e8f1f563ec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:17.842051 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a1e508ec-1b37-4e1a-bb1c-a5e8f1f563ec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:17.842483 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a1e508ec-1b37-4e1a-bb1c-a5e8f1f563ec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:17.970925 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a1e508ec-1b37-4e1a-bb1c-a5e8f1f563ec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:17.979583 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a1e508ec-1b37-4e1a-bb1c-a5e8f1f563ec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:17.981063 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a1e508ec-1b37-4e1a-bb1c-a5e8f1f563ec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:17.982228 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a1e508ec-1b37-4e1a-bb1c-a5e8f1f563ec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1724 microversion: 2.20 time: 0.154127 Oct 03 12:54:17.982788 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 271/543] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:54:17 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:54:19.009706 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-036cb58a-933b-41e8-bb05-94d3a65aeb81 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:19.010332 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-036cb58a-933b-41e8-bb05-94d3a65aeb81 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:19.016706 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-036cb58a-933b-41e8-bb05-94d3a65aeb81 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:19.017197 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-036cb58a-933b-41e8-bb05-94d3a65aeb81 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:19.017638 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-036cb58a-933b-41e8-bb05-94d3a65aeb81 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:19.018339 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-036cb58a-933b-41e8-bb05-94d3a65aeb81 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:19.018798 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-036cb58a-933b-41e8-bb05-94d3a65aeb81 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:19.019237 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-036cb58a-933b-41e8-bb05-94d3a65aeb81 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:19.166074 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-036cb58a-933b-41e8-bb05-94d3a65aeb81 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:19.174364 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-036cb58a-933b-41e8-bb05-94d3a65aeb81 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:19.175833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-036cb58a-933b-41e8-bb05-94d3a65aeb81 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:19.177001 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-036cb58a-933b-41e8-bb05-94d3a65aeb81 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1724 microversion: 2.20 time: 0.172532 Oct 03 12:54:19.184115 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 273/544] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:54:19 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:54:19.480760 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-402608f6-75b8-47fc-b845-1140e3a5f0e0 req-08d68a59-5ce6-4d6b-af28-deef1fa5ada6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54982238-81ba-4d23-b642-e3a37f778b4a", "name": "network-vif-deleted", "tag": "e846a01d-6972-40c0-b292-bc930ec8ca6d"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:54:19.496460 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-402608f6-75b8-47fc-b845-1140e3a5f0e0 req-08d68a59-5ce6-4d6b-af28-deef1fa5ada6 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:19.496940 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-402608f6-75b8-47fc-b845-1140e3a5f0e0 req-08d68a59-5ce6-4d6b-af28-deef1fa5ada6 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:19.497416 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-402608f6-75b8-47fc-b845-1140e3a5f0e0 req-08d68a59-5ce6-4d6b-af28-deef1fa5ada6 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:19.510949 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-402608f6-75b8-47fc-b845-1140e3a5f0e0 req-08d68a59-5ce6-4d6b-af28-deef1fa5ada6 service nova] Creating event network-vif-deleted:e846a01d-6972-40c0-b292-bc930ec8ca6d for instance 54982238-81ba-4d23-b642-e3a37f778b4a on hv-cinder-84456 Oct 03 12:54:19.516607 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-402608f6-75b8-47fc-b845-1140e3a5f0e0 req-08d68a59-5ce6-4d6b-af28-deef1fa5ada6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040567 Oct 03 12:54:19.517314 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 272/545] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:54:20.202268 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-4d14cbf6-9304-4684-8671-6f5dbc86c91b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:20.203089 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-4d14cbf6-9304-4684-8671-6f5dbc86c91b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:20.212914 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4d14cbf6-9304-4684-8671-6f5dbc86c91b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:20.213668 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4d14cbf6-9304-4684-8671-6f5dbc86c91b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:20.214342 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4d14cbf6-9304-4684-8671-6f5dbc86c91b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:20.215499 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4d14cbf6-9304-4684-8671-6f5dbc86c91b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:20.216208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4d14cbf6-9304-4684-8671-6f5dbc86c91b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:20.216875 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4d14cbf6-9304-4684-8671-6f5dbc86c91b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:20.252998 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4d14cbf6-9304-4684-8671-6f5dbc86c91b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:20.253568 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4d14cbf6-9304-4684-8671-6f5dbc86c91b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:20.254091 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4d14cbf6-9304-4684-8671-6f5dbc86c91b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:20.254654 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-4d14cbf6-9304-4684-8671-6f5dbc86c91b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lazy-loading 'fault' on Instance uuid 54982238-81ba-4d23-b642-e3a37f778b4a {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:54:20.299364 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4d14cbf6-9304-4684-8671-6f5dbc86c91b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:20.308153 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4d14cbf6-9304-4684-8671-6f5dbc86c91b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:20.309751 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4d14cbf6-9304-4684-8671-6f5dbc86c91b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:20.310990 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-4d14cbf6-9304-4684-8671-6f5dbc86c91b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 200 len: 1371 microversion: 2.20 time: 0.112819 Oct 03 12:54:20.311674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 274/546] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:54:20 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:54:21.339110 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-452e0d3b-a7f5-4ff7-8b75-5fd67f2e0498 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:21.339756 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-452e0d3b-a7f5-4ff7-8b75-5fd67f2e0498 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:21.346073 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-452e0d3b-a7f5-4ff7-8b75-5fd67f2e0498 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:21.346698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-452e0d3b-a7f5-4ff7-8b75-5fd67f2e0498 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:21.347012 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-452e0d3b-a7f5-4ff7-8b75-5fd67f2e0498 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:21.347968 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-452e0d3b-a7f5-4ff7-8b75-5fd67f2e0498 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:21.348447 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-452e0d3b-a7f5-4ff7-8b75-5fd67f2e0498 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:21.348865 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-452e0d3b-a7f5-4ff7-8b75-5fd67f2e0498 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:21.363274 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-452e0d3b-a7f5-4ff7-8b75-5fd67f2e0498 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] HTTP exception thrown: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-452e0d3b-a7f5-4ff7-8b75-5fd67f2e0498 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Request method failure captured: Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a HTTP/1.1 Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtpqN0A1AScPSBypLI-JbH0UDLrhASTks7mvtLawNlsOidm0hdjGz2a-QOjMg40cwaPF86268eigWpbKpq4Y_quVTfJ9vogC3Ouk0aQAOfC09_oM1yy3-0LqPUI270PdBJycSQZ7skVRHDVt0p-ftPVnlBPABbDN6WxCNFZiknV5UGA Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 0e20f793bd0b46a59df730183818d9f8 Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:54:21.364941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:54:21.367500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:54:21.367500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:54:21.367500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 0e20f793bd0b46a59df730183818d9f8 Oct 03 12:54:21.367500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:54:21.367500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-AttachVolumeShelveTestJSON-1471209770-project Oct 03 12:54:21.367500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:54:21.367500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:54:21.367500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 676b2a6bbf6e4df1b47dba2a9b8e8862 Oct 03 12:54:21.367500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1471209770-project Oct 03 12:54:21.367500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:54:21.367500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. Oct 03 12:54:21.367500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': '54982238-81ba-4d23-b642-e3a37f778b4a'} Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:54:21.368428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. Oct 03 12:54:21.370232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:54:21.371543 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-452e0d3b-a7f5-4ff7-8b75-5fd67f2e0498 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Returning 404 to user: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:54:21.371543 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-452e0d3b-a7f5-4ff7-8b75-5fd67f2e0498 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 404 len: 111 microversion: 2.20 time: 0.033815 Oct 03 12:54:21.371711 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 273/547] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:54:21 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 12:54:21.376780 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e84b4557-5356-420d-9774-427295c88a40 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '.version_select at 0x7fc740275430>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:21.382603 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e84b4557-5356-420d-9774-427295c88a40 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [0c2e2323-08c6-4e15-a575-e25ba3d422e4] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 12:54:22.390162 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO oslo.messaging._drivers.impl_rabbit [None req-e84b4557-5356-420d-9774-427295c88a40 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [0c2e2323-08c6-4e15-a575-e25ba3d422e4] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 34462. Oct 03 12:54:22.487876 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e84b4557-5356-420d-9774-427295c88a40 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1854368905" status: 204 len: 0 microversion: 2.20 time: 1.114854 Oct 03 12:54:22.488453 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 275/548] 10.222.0.33 () {60 vars in 1262 bytes} [Mon Oct 3 12:54:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1854368905 => generated 0 bytes in 1116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 12:54:22.655871 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-367e4400-d9bf-476d-8eef-750d01f6f86a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:22.658297 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-367e4400-d9bf-476d-8eef-750d01f6f86a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:22.665674 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-367e4400-d9bf-476d-8eef-750d01f6f86a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:22.666161 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-367e4400-d9bf-476d-8eef-750d01f6f86a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:22.666600 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-367e4400-d9bf-476d-8eef-750d01f6f86a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:22.667292 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-367e4400-d9bf-476d-8eef-750d01f6f86a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:22.667774 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-367e4400-d9bf-476d-8eef-750d01f6f86a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:22.668259 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-367e4400-d9bf-476d-8eef-750d01f6f86a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:22.706729 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-367e4400-d9bf-476d-8eef-750d01f6f86a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048195 Oct 03 12:54:22.706729 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 274/549] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 12:54:22 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 12:54:22.777034 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-cb254a09-315b-4059-9d27-7e9f5ab03654 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:22.777540 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-cb254a09-315b-4059-9d27-7e9f5ab03654 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:22.784250 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb254a09-315b-4059-9d27-7e9f5ab03654 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:22.784793 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb254a09-315b-4059-9d27-7e9f5ab03654 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:22.785189 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb254a09-315b-4059-9d27-7e9f5ab03654 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:22.785888 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb254a09-315b-4059-9d27-7e9f5ab03654 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:22.786353 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb254a09-315b-4059-9d27-7e9f5ab03654 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:22.786818 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb254a09-315b-4059-9d27-7e9f5ab03654 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:22.812432 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-cb254a09-315b-4059-9d27-7e9f5ab03654 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Going to try to terminate instance {{(pid=127544) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:54:23.119165 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-cb254a09-315b-4059-9d27-7e9f5ab03654 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 204 len: 0 microversion: 2.1 time: 0.345873 Oct 03 12:54:23.119801 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 276/550] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:54:22 2022] DELETE /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:54:23.128092 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c801eb0e-f0d6-4b5a-a7e1-b44df8af4f8e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:23.128714 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c801eb0e-f0d6-4b5a-a7e1-b44df8af4f8e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:23.135746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c801eb0e-f0d6-4b5a-a7e1-b44df8af4f8e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:23.136236 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c801eb0e-f0d6-4b5a-a7e1-b44df8af4f8e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:23.136678 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c801eb0e-f0d6-4b5a-a7e1-b44df8af4f8e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:23.137371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c801eb0e-f0d6-4b5a-a7e1-b44df8af4f8e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:23.137825 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c801eb0e-f0d6-4b5a-a7e1-b44df8af4f8e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:23.138256 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c801eb0e-f0d6-4b5a-a7e1-b44df8af4f8e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:23.260692 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0efc6aef-8b4d-4134-8134-83997ca9bc1c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Action: 'create', calling method: .version_select at 0x7fc74023da60>, body: {"keypair": {"name": "tempest-keypair-1569201522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOevTjosKpu8xtwFLy7hpnaMngoqqwFJzCPNcc+caiSgG/le3mavuCnqLHfJeeqRzKFK01+6mnpKMxyc8qheLSGV/rj5KP4J8zWOv6DJOLjYKar6AEoxgSSey3SbpuvzIw=="}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:54:23.277071 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-0efc6aef-8b4d-4134-8134-83997ca9bc1c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Getting quotas for project 0e20f793bd0b46a59df730183818d9f8. Resources: {'key_pairs'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:54:23.280896 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-0efc6aef-8b4d-4134-8134-83997ca9bc1c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Getting quotas for user 676b2a6bbf6e4df1b47dba2a9b8e8862 and project 0e20f793bd0b46a59df730183818d9f8. Resources: {'key_pairs'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:54:23.308925 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c801eb0e-f0d6-4b5a-a7e1-b44df8af4f8e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:23.315008 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c801eb0e-f0d6-4b5a-a7e1-b44df8af4f8e tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1673 microversion: 2.1 time: 0.190958 Oct 03 12:54:23.315589 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 275/551] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:23 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1673 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:23.348696 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0efc6aef-8b4d-4134-8134-83997ca9bc1c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.095292 Oct 03 12:54:23.349276 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 277/552] 10.222.0.33 () {62 vars in 1200 bytes} [Mon Oct 3 12:54:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 12:54:24.338977 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-40a3bc60-0180-4d88-85ee-580d99d5c8cf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:24.339621 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-40a3bc60-0180-4d88-85ee-580d99d5c8cf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:24.346309 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40a3bc60-0180-4d88-85ee-580d99d5c8cf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:24.346813 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40a3bc60-0180-4d88-85ee-580d99d5c8cf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:24.347304 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40a3bc60-0180-4d88-85ee-580d99d5c8cf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:24.348044 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40a3bc60-0180-4d88-85ee-580d99d5c8cf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:24.348708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40a3bc60-0180-4d88-85ee-580d99d5c8cf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:24.348936 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40a3bc60-0180-4d88-85ee-580d99d5c8cf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:24.488792 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-40a3bc60-0180-4d88-85ee-580d99d5c8cf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:24.497652 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-40a3bc60-0180-4d88-85ee-580d99d5c8cf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1673 microversion: 2.1 time: 0.163412 Oct 03 12:54:24.498214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 276/553] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:24 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:25.522132 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2719c77e-24df-46b5-9bda-72d68797b0db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:25.523557 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2719c77e-24df-46b5-9bda-72d68797b0db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:25.530436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2719c77e-24df-46b5-9bda-72d68797b0db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:25.530925 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2719c77e-24df-46b5-9bda-72d68797b0db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:25.531382 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2719c77e-24df-46b5-9bda-72d68797b0db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:25.532090 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2719c77e-24df-46b5-9bda-72d68797b0db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:25.532546 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2719c77e-24df-46b5-9bda-72d68797b0db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:25.532972 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2719c77e-24df-46b5-9bda-72d68797b0db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:25.638010 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-594901590", "imageRef": "9d585789-e496-433d-b311-70ec7ceffd99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99c96330-3d0c-4416-8b2d-15be2ccdbc1b"}], "security_groups": [{"name": "tempest-securitygroup--1844965496"}], "key_name": "tempest-keypair-1569201522", "user_data": "}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:54:25.683578 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2719c77e-24df-46b5-9bda-72d68797b0db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:25.691182 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-2719c77e-24df-46b5-9bda-72d68797b0db tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1673 microversion: 2.1 time: 0.173584 Oct 03 12:54:25.691731 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 278/554] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:25 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:25.747643 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.network.neutron [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] validate_networks() for [('99c96330-3d0c-4416-8b2d-15be2ccdbc1b', None, None, None, None, None)] {{(pid=127542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:54:26.137334 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Flavor limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:54:26.137798 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Image limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:54:26.142881 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Flavor pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:54:26.142881 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Image pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:54:26.142881 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:54:26.148530 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:26.149099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:26.149618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:26.150476 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:26.151008 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:26.151544 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:26.169129 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Getting quotas for project 0e20f793bd0b46a59df730183818d9f8. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:54:26.173141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Getting quotas for user 676b2a6bbf6e4df1b47dba2a9b8e8862 and project 0e20f793bd0b46a59df730183818d9f8. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:54:26.185009 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Going to run 1 instances... {{(pid=127542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:54:26.187341 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d585789-e496-433d-b311-70ec7ceffd99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:54:26.319484 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-53c580c8-9b2f-4f15-b53e-8ea9b7e70202 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.685358 Oct 03 12:54:26.320311 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 277/555] 10.222.0.33 () {62 vars in 1188 bytes} [Mon Oct 3 12:54:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 03 12:54:26.331448 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9a2c62cd-2469-4d17-9cac-c97c46aaa981 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:26.332354 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-9a2c62cd-2469-4d17-9cac-c97c46aaa981 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:26.526684 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9a2c62cd-2469-4d17-9cac-c97c46aaa981 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:26.536618 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9a2c62cd-2469-4d17-9cac-c97c46aaa981 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:26.539452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9a2c62cd-2469-4d17-9cac-c97c46aaa981 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:26.540765 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-9a2c62cd-2469-4d17-9cac-c97c46aaa981 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1281 microversion: 2.20 time: 0.213452 Oct 03 12:54:26.541335 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 279/556] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:54:26 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1281 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:54:26.597963 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-528515ee-c66e-429a-b5e4-83afa71fbcb8 req-72d113cb-e189-4c58-880b-a3a5069468b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a980d091-a942-46bc-a139-d12f9e2167ed", "name": "network-vif-deleted", "tag": "b6c921d4-a92a-4c27-89cc-adf792fee725"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:54:26.609320 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-528515ee-c66e-429a-b5e4-83afa71fbcb8 req-72d113cb-e189-4c58-880b-a3a5069468b0 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:26.609930 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-528515ee-c66e-429a-b5e4-83afa71fbcb8 req-72d113cb-e189-4c58-880b-a3a5069468b0 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:26.610445 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-528515ee-c66e-429a-b5e4-83afa71fbcb8 req-72d113cb-e189-4c58-880b-a3a5069468b0 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:26.622936 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-528515ee-c66e-429a-b5e4-83afa71fbcb8 req-72d113cb-e189-4c58-880b-a3a5069468b0 service nova] Creating event network-vif-deleted:b6c921d4-a92a-4c27-89cc-adf792fee725 for instance a980d091-a942-46bc-a139-d12f9e2167ed on hv-cinder-84456 Oct 03 12:54:26.631783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-528515ee-c66e-429a-b5e4-83afa71fbcb8 req-72d113cb-e189-4c58-880b-a3a5069468b0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037587 Oct 03 12:54:26.632393 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 278/557] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:54:26.715409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2070e881-019a-4918-8413-3e48433d1848 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:26.716287 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2070e881-019a-4918-8413-3e48433d1848 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:26.723943 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2070e881-019a-4918-8413-3e48433d1848 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:26.724479 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2070e881-019a-4918-8413-3e48433d1848 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:26.726197 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2070e881-019a-4918-8413-3e48433d1848 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:26.726931 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2070e881-019a-4918-8413-3e48433d1848 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:26.727618 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2070e881-019a-4918-8413-3e48433d1848 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:26.728059 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2070e881-019a-4918-8413-3e48433d1848 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:26.802012 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2070e881-019a-4918-8413-3e48433d1848 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:26.814562 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-2070e881-019a-4918-8413-3e48433d1848 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1605 microversion: 2.1 time: 0.102895 Oct 03 12:54:26.816127 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 280/558] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:26 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1605 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:27.567219 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-47b605a1-867f-4191-a527-17aae76f19a3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:27.567958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-47b605a1-867f-4191-a527-17aae76f19a3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:27.575149 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-47b605a1-867f-4191-a527-17aae76f19a3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:27.575681 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-47b605a1-867f-4191-a527-17aae76f19a3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:27.576116 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-47b605a1-867f-4191-a527-17aae76f19a3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:27.576845 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-47b605a1-867f-4191-a527-17aae76f19a3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:27.577302 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-47b605a1-867f-4191-a527-17aae76f19a3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:27.577732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-47b605a1-867f-4191-a527-17aae76f19a3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:27.701799 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-47b605a1-867f-4191-a527-17aae76f19a3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:27.710875 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-47b605a1-867f-4191-a527-17aae76f19a3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:27.712392 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-47b605a1-867f-4191-a527-17aae76f19a3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:27.713745 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-47b605a1-867f-4191-a527-17aae76f19a3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1285 microversion: 2.20 time: 0.151329 Oct 03 12:54:27.714362 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 279/559] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:54:27 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:54:27.843905 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2e4ab0f3-2708-4799-90c2-2f31d285892b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:27.844531 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2e4ab0f3-2708-4799-90c2-2f31d285892b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:27.850622 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2e4ab0f3-2708-4799-90c2-2f31d285892b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:27.851110 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2e4ab0f3-2708-4799-90c2-2f31d285892b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:27.851575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2e4ab0f3-2708-4799-90c2-2f31d285892b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:27.852278 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2e4ab0f3-2708-4799-90c2-2f31d285892b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:27.852733 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2e4ab0f3-2708-4799-90c2-2f31d285892b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:27.853173 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2e4ab0f3-2708-4799-90c2-2f31d285892b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:27.886957 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2e4ab0f3-2708-4799-90c2-2f31d285892b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:27.887480 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2e4ab0f3-2708-4799-90c2-2f31d285892b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:27.888177 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2e4ab0f3-2708-4799-90c2-2f31d285892b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:27.888721 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-2e4ab0f3-2708-4799-90c2-2f31d285892b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lazy-loading 'fault' on Instance uuid a980d091-a942-46bc-a139-d12f9e2167ed {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:54:27.931058 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2e4ab0f3-2708-4799-90c2-2f31d285892b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:27.938920 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-2e4ab0f3-2708-4799-90c2-2f31d285892b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 200 len: 1326 microversion: 2.1 time: 0.098843 Oct 03 12:54:27.939515 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 281/560] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:27 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:28.739047 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c5470968-f71b-4ee8-9303-c660f895e2e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:28.739660 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c5470968-f71b-4ee8-9303-c660f895e2e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:28.747021 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5470968-f71b-4ee8-9303-c660f895e2e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:28.747833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5470968-f71b-4ee8-9303-c660f895e2e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:28.748042 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5470968-f71b-4ee8-9303-c660f895e2e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:28.748729 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5470968-f71b-4ee8-9303-c660f895e2e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:28.749180 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5470968-f71b-4ee8-9303-c660f895e2e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:28.749605 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5470968-f71b-4ee8-9303-c660f895e2e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:28.815148 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c5470968-f71b-4ee8-9303-c660f895e2e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:28.823698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c5470968-f71b-4ee8-9303-c660f895e2e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:28.825152 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c5470968-f71b-4ee8-9303-c660f895e2e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:28.826270 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c5470968-f71b-4ee8-9303-c660f895e2e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1333 microversion: 2.20 time: 0.091316 Oct 03 12:54:28.826825 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 280/561] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:54:28 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:54:28.963891 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-034395b9-b47c-4727-a8a4-167f9ae877ac tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:28.964507 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-034395b9-b47c-4727-a8a4-167f9ae877ac tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:28.970954 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-034395b9-b47c-4727-a8a4-167f9ae877ac tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:28.971478 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-034395b9-b47c-4727-a8a4-167f9ae877ac tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:28.972099 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-034395b9-b47c-4727-a8a4-167f9ae877ac tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:28.972805 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-034395b9-b47c-4727-a8a4-167f9ae877ac tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:28.973259 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-034395b9-b47c-4727-a8a4-167f9ae877ac tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:28.973703 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-034395b9-b47c-4727-a8a4-167f9ae877ac tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:28.988130 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-034395b9-b47c-4727-a8a4-167f9ae877ac tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] HTTP exception thrown: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-034395b9-b47c-4727-a8a4-167f9ae877ac tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Request method failure captured: Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed HTTP/1.1 Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtpqveAWd5CfrsBJwJ-Bq-Llx8KmrbMxOIBesMnErADsus0b_wqY-2tmcSYAAz2WfEJ7g-jJZEnFBk9mJ4D5lxpIvp8Y1RcIXWQiqIZkavte4X7fbzVp0l8551bmo8lX1QJOgKeKQkz1VzGt6VpqDhc35pWwkzdfdezYsA_Ijwfe7OQ Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: cc40d256f0e24050b6b53fdbcbce1962 Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 12:54:28.989841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 12:54:28.992903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:54:28.992903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:54:28.992903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: cc40d256f0e24050b6b53fdbcbce1962 Oct 03 12:54:28.992903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:54:28.992903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-AttachVolumeTestJSON-1115138470-project Oct 03 12:54:28.992903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 12:54:28.992903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 12:54:28.992903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: bd24d209dc9644e8b2860a0e676acd3b Oct 03 12:54:28.992903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-AttachVolumeTestJSON-1115138470-project Oct 03 12:54:28.992903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 12:54:28.992903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. Oct 03 12:54:28.992903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': 'a980d091-a942-46bc-a139-d12f9e2167ed'} Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:54:28.993810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. Oct 03 12:54:28.995040 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:54:28.996404 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-034395b9-b47c-4727-a8a4-167f9ae877ac tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Returning 404 to user: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:54:28.996404 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-034395b9-b47c-4727-a8a4-167f9ae877ac tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 404 len: 111 microversion: 2.1 time: 0.032518 Oct 03 12:54:28.996404 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 282/562] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:28 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:54:29.001423 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-88e95494-f5a7-4150-a31a-b62089db112f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '.version_select at 0x7fc74025e430>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:29.093068 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-88e95494-f5a7-4150-a31a-b62089db112f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409910373" status: 202 len: 0 microversion: 2.1 time: 0.094910 Oct 03 12:54:29.094325 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 281/563] 10.222.0.33 () {58 vars in 1221 bytes} [Mon Oct 3 12:54:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409910373 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:54:29.853074 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-1447035d-1da8-459d-8770-ebce6415e4c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:29.853687 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-1447035d-1da8-459d-8770-ebce6415e4c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:29.860015 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1447035d-1da8-459d-8770-ebce6415e4c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:29.860578 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1447035d-1da8-459d-8770-ebce6415e4c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:29.861109 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1447035d-1da8-459d-8770-ebce6415e4c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:29.862117 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1447035d-1da8-459d-8770-ebce6415e4c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:29.862739 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1447035d-1da8-459d-8770-ebce6415e4c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:29.863170 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1447035d-1da8-459d-8770-ebce6415e4c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:29.918303 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1dc850a2-236c-4eeb-8a2b-a32f586ca41d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Action: 'create', calling method: .version_select at 0x7fc7400b1040>, body: {"keypair": {"name": "tempest-keypair-589992174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUDUc8cTR3SbVgPcvCnWFcYVmk23+IhoQjH8pniGf0YesmHD843FQNrAbjqKQ4EnMw0SWctyer74qa9qGPcNCoN7u/cgc0oJMehKhp84DjRC0wgieVqNNdSEOCYBUcgvQ=="}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:54:29.935859 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-1dc850a2-236c-4eeb-8a2b-a32f586ca41d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Getting quotas for project cc40d256f0e24050b6b53fdbcbce1962. Resources: {'key_pairs'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:54:29.940731 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-1dc850a2-236c-4eeb-8a2b-a32f586ca41d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Getting quotas for user bd24d209dc9644e8b2860a0e676acd3b and project cc40d256f0e24050b6b53fdbcbce1962. Resources: {'key_pairs'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:54:30.007876 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-1447035d-1da8-459d-8770-ebce6415e4c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:30.016298 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-1447035d-1da8-459d-8770-ebce6415e4c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:30.017771 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-1447035d-1da8-459d-8770-ebce6415e4c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:30.018870 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-1447035d-1da8-459d-8770-ebce6415e4c1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1407 microversion: 2.20 time: 0.169969 Oct 03 12:54:30.019436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 283/564] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:54:29 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:54:30.031380 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-1dc850a2-236c-4eeb-8a2b-a32f586ca41d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.123786 Oct 03 12:54:30.032222 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 282/565] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 12:54:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:54:30.646365 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-50c8ddf8-b706-4574-905f-c0ff198565c8 req-814cba31-5fe2-4e49-8677-1849d246483d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b37dd24-5a6e-4898-8247-8e00786088ea", "tag": "778fd61a-2cb6-43b5-ad14-c9a69f32bf7c"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:54:30.659935 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-50c8ddf8-b706-4574-905f-c0ff198565c8 req-814cba31-5fe2-4e49-8677-1849d246483d service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:30.660082 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-50c8ddf8-b706-4574-905f-c0ff198565c8 req-814cba31-5fe2-4e49-8677-1849d246483d service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:30.660486 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-50c8ddf8-b706-4574-905f-c0ff198565c8 req-814cba31-5fe2-4e49-8677-1849d246483d service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:30.672482 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-50c8ddf8-b706-4574-905f-c0ff198565c8 req-814cba31-5fe2-4e49-8677-1849d246483d service nova] Creating event network-changed:778fd61a-2cb6-43b5-ad14-c9a69f32bf7c for instance 6b37dd24-5a6e-4898-8247-8e00786088ea on hv-cinder-84456 Oct 03 12:54:30.678364 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-50c8ddf8-b706-4574-905f-c0ff198565c8 req-814cba31-5fe2-4e49-8677-1849d246483d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035220 Oct 03 12:54:30.679230 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 284/566] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:54:31.045820 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3a2349cc-0fa1-4131-b829-101e105bf3e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:31.046609 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3a2349cc-0fa1-4131-b829-101e105bf3e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:31.053443 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3a2349cc-0fa1-4131-b829-101e105bf3e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:31.053948 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3a2349cc-0fa1-4131-b829-101e105bf3e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:31.054395 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3a2349cc-0fa1-4131-b829-101e105bf3e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:31.055338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3a2349cc-0fa1-4131-b829-101e105bf3e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:31.055899 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3a2349cc-0fa1-4131-b829-101e105bf3e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:31.056341 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3a2349cc-0fa1-4131-b829-101e105bf3e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:31.253814 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3a2349cc-0fa1-4131-b829-101e105bf3e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:31.262684 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3a2349cc-0fa1-4131-b829-101e105bf3e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:31.264340 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3a2349cc-0fa1-4131-b829-101e105bf3e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:31.265688 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3a2349cc-0fa1-4131-b829-101e105bf3e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1407 microversion: 2.20 time: 0.224840 Oct 03 12:54:31.266247 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 283/567] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:54:31 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:54:32.241881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-504811389", "imageRef": "9d585789-e496-433d-b311-70ec7ceffd99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "848e2135-07d9-46d2-afff-ed218ebac86b"}], "security_groups": [{"name": "tempest-securitygroup--2017194481"}], "key_name": "tempest-keypair-589992174", "user_data": "}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:54:32.292141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a4c63640-5a3b-43e3-aa91-bfd7f05018ba tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:32.292773 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a4c63640-5a3b-43e3-aa91-bfd7f05018ba tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:32.299360 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a4c63640-5a3b-43e3-aa91-bfd7f05018ba tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:32.299860 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a4c63640-5a3b-43e3-aa91-bfd7f05018ba tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:32.300302 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a4c63640-5a3b-43e3-aa91-bfd7f05018ba tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:32.301020 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a4c63640-5a3b-43e3-aa91-bfd7f05018ba tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:32.301493 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a4c63640-5a3b-43e3-aa91-bfd7f05018ba tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:32.301913 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a4c63640-5a3b-43e3-aa91-bfd7f05018ba tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:32.357914 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.network.neutron [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] validate_networks() for [('848e2135-07d9-46d2-afff-ed218ebac86b', None, None, None, None, None)] {{(pid=127544) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:54:32.520038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a4c63640-5a3b-43e3-aa91-bfd7f05018ba tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:32.528480 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a4c63640-5a3b-43e3-aa91-bfd7f05018ba tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:32.530011 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a4c63640-5a3b-43e3-aa91-bfd7f05018ba tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:32.531217 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a4c63640-5a3b-43e3-aa91-bfd7f05018ba tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1407 microversion: 2.20 time: 0.244088 Oct 03 12:54:32.531904 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 284/568] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:54:32 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:54:32.779005 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Flavor limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:54:32.779473 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Image limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:54:32.779982 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Flavor pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:54:32.780398 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Image pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:54:32.780816 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:54:32.790653 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:32.791141 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:32.791629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:32.792368 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:32.792830 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:32.793260 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:32.810282 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Getting quotas for project cc40d256f0e24050b6b53fdbcbce1962. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:54:32.814209 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Getting quotas for user bd24d209dc9644e8b2860a0e676acd3b and project cc40d256f0e24050b6b53fdbcbce1962. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:54:32.825943 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Going to run 1 instances... {{(pid=127544) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:54:32.828427 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d585789-e496-433d-b311-70ec7ceffd99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:54:32.983929 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ff775fdf-5ad8-474f-b9f4-33efa81c1cf4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.748609 Oct 03 12:54:32.990573 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 285/569] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:54:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:54:32.996451 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8ea81b4c-658b-45a9-81c6-d0ced062cd7b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:32.997078 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8ea81b4c-658b-45a9-81c6-d0ced062cd7b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:33.052858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8ea81b4c-658b-45a9-81c6-d0ced062cd7b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:33.061483 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8ea81b4c-658b-45a9-81c6-d0ced062cd7b tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1236 microversion: 2.1 time: 0.069240 Oct 03 12:54:33.062060 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 285/570] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:32 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1236 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:33.557861 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-cd6f54a7-4639-4fce-a401-a07ec5de2f01 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:33.558480 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-cd6f54a7-4639-4fce-a401-a07ec5de2f01 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:33.566051 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cd6f54a7-4639-4fce-a401-a07ec5de2f01 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:33.566537 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cd6f54a7-4639-4fce-a401-a07ec5de2f01 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:33.566977 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cd6f54a7-4639-4fce-a401-a07ec5de2f01 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:33.567702 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cd6f54a7-4639-4fce-a401-a07ec5de2f01 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:33.568815 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cd6f54a7-4639-4fce-a401-a07ec5de2f01 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:33.569246 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cd6f54a7-4639-4fce-a401-a07ec5de2f01 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:33.706349 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-cd6f54a7-4639-4fce-a401-a07ec5de2f01 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:33.715357 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-cd6f54a7-4639-4fce-a401-a07ec5de2f01 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:33.716799 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-cd6f54a7-4639-4fce-a401-a07ec5de2f01 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:33.717889 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-cd6f54a7-4639-4fce-a401-a07ec5de2f01 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1407 microversion: 2.20 time: 0.164072 Oct 03 12:54:33.718441 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 286/571] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:54:33 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:54:34.085831 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-14b8843b-cacc-4beb-9b72-5354781493bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:34.086448 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-14b8843b-cacc-4beb-9b72-5354781493bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:34.092822 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-14b8843b-cacc-4beb-9b72-5354781493bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:34.093377 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-14b8843b-cacc-4beb-9b72-5354781493bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:34.093756 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-14b8843b-cacc-4beb-9b72-5354781493bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:34.094455 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-14b8843b-cacc-4beb-9b72-5354781493bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:34.094914 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-14b8843b-cacc-4beb-9b72-5354781493bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:34.095359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-14b8843b-cacc-4beb-9b72-5354781493bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:34.159292 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-14b8843b-cacc-4beb-9b72-5354781493bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:34.168321 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-14b8843b-cacc-4beb-9b72-5354781493bf tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1232 microversion: 2.1 time: 0.086914 Oct 03 12:54:34.168901 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 286/572] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:34 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1232 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:34.748098 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9518fe32-54fa-40d5-99fb-bf0505c4049f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:34.748761 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-9518fe32-54fa-40d5-99fb-bf0505c4049f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:34.755045 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9518fe32-54fa-40d5-99fb-bf0505c4049f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:34.755563 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9518fe32-54fa-40d5-99fb-bf0505c4049f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:34.756000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9518fe32-54fa-40d5-99fb-bf0505c4049f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:34.756678 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9518fe32-54fa-40d5-99fb-bf0505c4049f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:34.757190 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9518fe32-54fa-40d5-99fb-bf0505c4049f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:34.757782 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9518fe32-54fa-40d5-99fb-bf0505c4049f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:34.885180 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9518fe32-54fa-40d5-99fb-bf0505c4049f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:34.893292 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9518fe32-54fa-40d5-99fb-bf0505c4049f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:34.894714 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9518fe32-54fa-40d5-99fb-bf0505c4049f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:34.895856 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-9518fe32-54fa-40d5-99fb-bf0505c4049f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1407 microversion: 2.20 time: 0.151725 Oct 03 12:54:34.896409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 287/573] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:54:34 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:54:35.182410 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-1b641508-a1a3-45c2-9ffe-9f23d2647f7a req-223d9b97-cd5c-45bc-bcb7-65725b1f0614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b37dd24-5a6e-4898-8247-8e00786088ea", "name": "network-vif-plugged", "status": "completed", "tag": "778fd61a-2cb6-43b5-ad14-c9a69f32bf7c"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:54:35.193609 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-dfd06eac-6684-4ca2-a925-cad184d381e9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:35.195124 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-dfd06eac-6684-4ca2-a925-cad184d381e9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:35.195582 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-1b641508-a1a3-45c2-9ffe-9f23d2647f7a req-223d9b97-cd5c-45bc-bcb7-65725b1f0614 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:35.196074 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-1b641508-a1a3-45c2-9ffe-9f23d2647f7a req-223d9b97-cd5c-45bc-bcb7-65725b1f0614 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:35.196504 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-1b641508-a1a3-45c2-9ffe-9f23d2647f7a req-223d9b97-cd5c-45bc-bcb7-65725b1f0614 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:35.203380 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dfd06eac-6684-4ca2-a925-cad184d381e9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:35.203890 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dfd06eac-6684-4ca2-a925-cad184d381e9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:35.204500 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dfd06eac-6684-4ca2-a925-cad184d381e9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:35.205214 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dfd06eac-6684-4ca2-a925-cad184d381e9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:35.205850 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dfd06eac-6684-4ca2-a925-cad184d381e9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:35.206894 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dfd06eac-6684-4ca2-a925-cad184d381e9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:35.207479 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-1b641508-a1a3-45c2-9ffe-9f23d2647f7a req-223d9b97-cd5c-45bc-bcb7-65725b1f0614 service nova] Creating event network-vif-plugged:778fd61a-2cb6-43b5-ad14-c9a69f32bf7c for instance 6b37dd24-5a6e-4898-8247-8e00786088ea on hv-cinder-84456 Oct 03 12:54:35.214413 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-1b641508-a1a3-45c2-9ffe-9f23d2647f7a req-223d9b97-cd5c-45bc-bcb7-65725b1f0614 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035263 Oct 03 12:54:35.218472 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 287/574] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:54:35.218903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:35.305626 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-dfd06eac-6684-4ca2-a925-cad184d381e9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:35.322294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-dfd06eac-6684-4ca2-a925-cad184d381e9 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1296 microversion: 2.1 time: 0.133866 Oct 03 12:54:35.323707 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 288/575] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:35 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1296 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:35.921547 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-352b1652-fcd1-48d2-bf93-53419f263e30 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:35.922045 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-352b1652-fcd1-48d2-bf93-53419f263e30 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:35.932332 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-352b1652-fcd1-48d2-bf93-53419f263e30 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:35.932844 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-352b1652-fcd1-48d2-bf93-53419f263e30 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:35.933295 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-352b1652-fcd1-48d2-bf93-53419f263e30 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:35.934068 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-352b1652-fcd1-48d2-bf93-53419f263e30 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:35.934477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-352b1652-fcd1-48d2-bf93-53419f263e30 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:35.934906 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-352b1652-fcd1-48d2-bf93-53419f263e30 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:35.954967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:36.079265 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-352b1652-fcd1-48d2-bf93-53419f263e30 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:36.090397 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-352b1652-fcd1-48d2-bf93-53419f263e30 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:36.091897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-352b1652-fcd1-48d2-bf93-53419f263e30 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:36.093050 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-352b1652-fcd1-48d2-bf93-53419f263e30 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1407 microversion: 2.20 time: 0.175988 Oct 03 12:54:36.093822 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 288/576] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:54:35 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:54:36.357510 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b6c9c080-3f1d-42a8-8433-a803f4237dc1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:36.358211 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-b6c9c080-3f1d-42a8-8433-a803f4237dc1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:36.365731 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b6c9c080-3f1d-42a8-8433-a803f4237dc1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:36.366983 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b6c9c080-3f1d-42a8-8433-a803f4237dc1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:36.367443 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b6c9c080-3f1d-42a8-8433-a803f4237dc1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:36.368229 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b6c9c080-3f1d-42a8-8433-a803f4237dc1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:36.368684 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b6c9c080-3f1d-42a8-8433-a803f4237dc1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:36.369108 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b6c9c080-3f1d-42a8-8433-a803f4237dc1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:36.503794 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-b6c9c080-3f1d-42a8-8433-a803f4237dc1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:36.512711 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-b6c9c080-3f1d-42a8-8433-a803f4237dc1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1362 microversion: 2.1 time: 0.159698 Oct 03 12:54:36.513295 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 289/577] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:36 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:36.856148 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-8abfa685-198c-41fe-a70a-f3352bbd317b req-5dc01aaa-e962-418b-9867-fece7cfd7d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03a5c967-4163-4841-ae8c-77d508c0ff59", "tag": "cf688afb-8bbc-40e1-934b-cdf7069fca35"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:54:36.861002 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:36.869220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-8abfa685-198c-41fe-a70a-f3352bbd317b req-5dc01aaa-e962-418b-9867-fece7cfd7d03 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:36.869802 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-8abfa685-198c-41fe-a70a-f3352bbd317b req-5dc01aaa-e962-418b-9867-fece7cfd7d03 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:36.870254 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-8abfa685-198c-41fe-a70a-f3352bbd317b req-5dc01aaa-e962-418b-9867-fece7cfd7d03 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:36.883525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-8abfa685-198c-41fe-a70a-f3352bbd317b req-5dc01aaa-e962-418b-9867-fece7cfd7d03 service nova] Creating event network-changed:cf688afb-8bbc-40e1-934b-cdf7069fca35 for instance 03a5c967-4163-4841-ae8c-77d508c0ff59 on hv-cinder-84456 Oct 03 12:54:36.888604 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-8abfa685-198c-41fe-a70a-f3352bbd317b req-5dc01aaa-e962-418b-9867-fece7cfd7d03 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037617 Oct 03 12:54:36.889201 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 289/578] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:54:37.121567 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ba42dc75-2639-4627-8218-c05783d3f8df tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:37.122366 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ba42dc75-2639-4627-8218-c05783d3f8df tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:37.129219 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ba42dc75-2639-4627-8218-c05783d3f8df tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:37.129705 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ba42dc75-2639-4627-8218-c05783d3f8df tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:37.130213 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ba42dc75-2639-4627-8218-c05783d3f8df tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:37.130939 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ba42dc75-2639-4627-8218-c05783d3f8df tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:37.131456 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ba42dc75-2639-4627-8218-c05783d3f8df tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:37.138505 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ba42dc75-2639-4627-8218-c05783d3f8df tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:37.150034 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-6211ebb0-c810-4f67-90f9-20325245e9f2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:37.150660 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-6211ebb0-c810-4f67-90f9-20325245e9f2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:37.159775 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6211ebb0-c810-4f67-90f9-20325245e9f2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:37.160272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6211ebb0-c810-4f67-90f9-20325245e9f2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:37.160714 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6211ebb0-c810-4f67-90f9-20325245e9f2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:37.161503 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6211ebb0-c810-4f67-90f9-20325245e9f2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:37.161966 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6211ebb0-c810-4f67-90f9-20325245e9f2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:37.162426 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6211ebb0-c810-4f67-90f9-20325245e9f2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:37.249905 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-6211ebb0-c810-4f67-90f9-20325245e9f2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lazy-loading 'services' on Instance uuid 85d3f4ae-60a5-4463-9a02-00d846d22289 {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:54:37.268823 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-ba42dc75-2639-4627-8218-c05783d3f8df tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:37.278241 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-ba42dc75-2639-4627-8218-c05783d3f8df tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:37.279834 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-ba42dc75-2639-4627-8218-c05783d3f8df tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:37.281050 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ba42dc75-2639-4627-8218-c05783d3f8df tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1407 microversion: 2.20 time: 0.165408 Oct 03 12:54:37.281708 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 290/579] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:54:37 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:54:37.532011 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-6211ebb0-c810-4f67-90f9-20325245e9f2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "DELETE /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-volume_attachments/04dc6a57-1ed6-4c6e-a423-b0ad9c899e11" status: 202 len: 0 microversion: 2.1 time: 0.386876 Oct 03 12:54:37.532666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 290/580] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 12:54:37 2022] DELETE /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-volume_attachments/04dc6a57-1ed6-4c6e-a423-b0ad9c899e11 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 12:54:37.538030 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-1491997b-e3e1-4b10-9f3d-9ef2d93ff7e3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:37.539253 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-1491997b-e3e1-4b10-9f3d-9ef2d93ff7e3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:37.542101 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-fd187c78-21d4-475c-8da8-94b401873a06 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:37.544481 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-fd187c78-21d4-475c-8da8-94b401873a06 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:37.545977 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1491997b-e3e1-4b10-9f3d-9ef2d93ff7e3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:37.546465 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1491997b-e3e1-4b10-9f3d-9ef2d93ff7e3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:37.546898 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1491997b-e3e1-4b10-9f3d-9ef2d93ff7e3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:37.547615 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1491997b-e3e1-4b10-9f3d-9ef2d93ff7e3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:37.548125 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1491997b-e3e1-4b10-9f3d-9ef2d93ff7e3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:37.548545 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1491997b-e3e1-4b10-9f3d-9ef2d93ff7e3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:37.550813 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd187c78-21d4-475c-8da8-94b401873a06 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:37.551302 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd187c78-21d4-475c-8da8-94b401873a06 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:37.551763 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd187c78-21d4-475c-8da8-94b401873a06 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:37.552459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd187c78-21d4-475c-8da8-94b401873a06 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:37.552918 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd187c78-21d4-475c-8da8-94b401873a06 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:37.553355 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd187c78-21d4-475c-8da8-94b401873a06 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:37.583555 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-fd187c78-21d4-475c-8da8-94b401873a06 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046156 Oct 03 12:54:37.584127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 291/581] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 12:54:37 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:54:37.682766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-1491997b-e3e1-4b10-9f3d-9ef2d93ff7e3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:37.690684 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-1491997b-e3e1-4b10-9f3d-9ef2d93ff7e3 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1362 microversion: 2.1 time: 0.156377 Oct 03 12:54:37.691246 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 291/582] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:37 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:38.307605 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-47023754-02ab-4c3c-b200-47986f387d52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:38.308356 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-47023754-02ab-4c3c-b200-47986f387d52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:38.315135 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-47023754-02ab-4c3c-b200-47986f387d52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:38.315854 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-47023754-02ab-4c3c-b200-47986f387d52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:38.316312 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-47023754-02ab-4c3c-b200-47986f387d52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:38.317024 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-47023754-02ab-4c3c-b200-47986f387d52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:38.317472 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-47023754-02ab-4c3c-b200-47986f387d52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:38.317897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-47023754-02ab-4c3c-b200-47986f387d52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:38.459178 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-47023754-02ab-4c3c-b200-47986f387d52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:38.469038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-47023754-02ab-4c3c-b200-47986f387d52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:38.470426 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-47023754-02ab-4c3c-b200-47986f387d52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:38.471637 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-47023754-02ab-4c3c-b200-47986f387d52 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1600 microversion: 2.20 time: 0.168821 Oct 03 12:54:38.474023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 292/583] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:54:38 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:54:38.498464 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-36330cfd-ce7f-4819-b654-36537ceb5bc3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:38.498967 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-36330cfd-ce7f-4819-b654-36537ceb5bc3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:38.504900 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36330cfd-ce7f-4819-b654-36537ceb5bc3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:38.505310 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36330cfd-ce7f-4819-b654-36537ceb5bc3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:38.505759 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36330cfd-ce7f-4819-b654-36537ceb5bc3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:38.506457 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36330cfd-ce7f-4819-b654-36537ceb5bc3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:38.506940 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36330cfd-ce7f-4819-b654-36537ceb5bc3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:38.508472 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36330cfd-ce7f-4819-b654-36537ceb5bc3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:38.585164 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-36330cfd-ce7f-4819-b654-36537ceb5bc3 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090420 Oct 03 12:54:38.585933 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 292/584] 10.222.0.33 () {60 vars in 1316 bytes} [Mon Oct 3 12:54:38 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 12:54:38.598070 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-21757224-35d8-43da-ac01-5e56a9458ecc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:38.600549 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-21757224-35d8-43da-ac01-5e56a9458ecc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:38.608031 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21757224-35d8-43da-ac01-5e56a9458ecc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:38.608668 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21757224-35d8-43da-ac01-5e56a9458ecc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:38.609345 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21757224-35d8-43da-ac01-5e56a9458ecc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:38.610159 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21757224-35d8-43da-ac01-5e56a9458ecc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:38.610721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21757224-35d8-43da-ac01-5e56a9458ecc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:38.611272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21757224-35d8-43da-ac01-5e56a9458ecc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:38.651263 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-21757224-35d8-43da-ac01-5e56a9458ecc tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057398 Oct 03 12:54:38.652007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 293/585] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 12:54:38 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:54:38.712918 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-99ea88e5-dfb8-4dd5-89e8-bec6682802bc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:38.713534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-99ea88e5-dfb8-4dd5-89e8-bec6682802bc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:38.719418 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-99ea88e5-dfb8-4dd5-89e8-bec6682802bc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:38.719902 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-99ea88e5-dfb8-4dd5-89e8-bec6682802bc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:38.720340 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-99ea88e5-dfb8-4dd5-89e8-bec6682802bc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:38.721026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-99ea88e5-dfb8-4dd5-89e8-bec6682802bc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:38.721482 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-99ea88e5-dfb8-4dd5-89e8-bec6682802bc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:38.721907 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-99ea88e5-dfb8-4dd5-89e8-bec6682802bc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:39.177855 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-99ea88e5-dfb8-4dd5-89e8-bec6682802bc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:39.185652 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-99ea88e5-dfb8-4dd5-89e8-bec6682802bc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1362 microversion: 2.1 time: 0.476591 Oct 03 12:54:39.186222 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 293/586] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:38 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1362 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:39.665200 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4b50ef20-62e7-48ba-996a-85497da4ab20 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:39.668124 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-4b50ef20-62e7-48ba-996a-85497da4ab20 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:39.674709 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b50ef20-62e7-48ba-996a-85497da4ab20 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:39.677211 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b50ef20-62e7-48ba-996a-85497da4ab20 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:39.677211 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b50ef20-62e7-48ba-996a-85497da4ab20 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:39.677211 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b50ef20-62e7-48ba-996a-85497da4ab20 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:39.677211 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b50ef20-62e7-48ba-996a-85497da4ab20 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:39.677560 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b50ef20-62e7-48ba-996a-85497da4ab20 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:39.710842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-4b50ef20-62e7-48ba-996a-85497da4ab20 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049032 Oct 03 12:54:39.711497 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 294/587] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 12:54:39 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:54:39.918193 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-fd97ac04-8d99-43e0-8db2-83816f8d1d39 req-ca6491f0-fc8d-4205-ae39-2dee8233a241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b37dd24-5a6e-4898-8247-8e00786088ea", "tag": "778fd61a-2cb6-43b5-ad14-c9a69f32bf7c"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:54:39.927932 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-fd97ac04-8d99-43e0-8db2-83816f8d1d39 req-ca6491f0-fc8d-4205-ae39-2dee8233a241 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:39.928356 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-fd97ac04-8d99-43e0-8db2-83816f8d1d39 req-ca6491f0-fc8d-4205-ae39-2dee8233a241 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:39.929458 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-fd97ac04-8d99-43e0-8db2-83816f8d1d39 req-ca6491f0-fc8d-4205-ae39-2dee8233a241 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:39.941778 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-fd97ac04-8d99-43e0-8db2-83816f8d1d39 req-ca6491f0-fc8d-4205-ae39-2dee8233a241 service nova] Creating event network-changed:778fd61a-2cb6-43b5-ad14-c9a69f32bf7c for instance 6b37dd24-5a6e-4898-8247-8e00786088ea on hv-cinder-84456 Oct 03 12:54:39.947387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-fd97ac04-8d99-43e0-8db2-83816f8d1d39 req-ca6491f0-fc8d-4205-ae39-2dee8233a241 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032808 Oct 03 12:54:39.947988 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 294/588] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:54:40.212260 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3e77a234-14d8-4dfb-ab4f-ac2dbc83a8ef tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:40.213243 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3e77a234-14d8-4dfb-ab4f-ac2dbc83a8ef tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:40.219805 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3e77a234-14d8-4dfb-ab4f-ac2dbc83a8ef tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:40.220662 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3e77a234-14d8-4dfb-ab4f-ac2dbc83a8ef tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:40.221318 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3e77a234-14d8-4dfb-ab4f-ac2dbc83a8ef tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:40.222262 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3e77a234-14d8-4dfb-ab4f-ac2dbc83a8ef tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:40.222914 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3e77a234-14d8-4dfb-ab4f-ac2dbc83a8ef tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:40.223573 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3e77a234-14d8-4dfb-ab4f-ac2dbc83a8ef tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:40.450685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3e77a234-14d8-4dfb-ab4f-ac2dbc83a8ef tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:40.458306 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3e77a234-14d8-4dfb-ab4f-ac2dbc83a8ef tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1362 microversion: 2.1 time: 0.249947 Oct 03 12:54:40.471865 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 295/589] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:40 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:40.724242 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0f863198-d4f4-4f70-b520-d25013c6fd21 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:40.726584 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-0f863198-d4f4-4f70-b520-d25013c6fd21 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:40.732928 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0f863198-d4f4-4f70-b520-d25013c6fd21 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:40.733420 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0f863198-d4f4-4f70-b520-d25013c6fd21 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:40.733856 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0f863198-d4f4-4f70-b520-d25013c6fd21 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:40.734558 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0f863198-d4f4-4f70-b520-d25013c6fd21 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:40.735018 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0f863198-d4f4-4f70-b520-d25013c6fd21 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:40.735584 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0f863198-d4f4-4f70-b520-d25013c6fd21 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:40.767296 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0f863198-d4f4-4f70-b520-d25013c6fd21 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047660 Oct 03 12:54:40.767894 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 295/590] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 12:54:40 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 12:54:40.846985 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-64441893-0e9d-498e-a085-bc7c0109d373 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:40.847520 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-64441893-0e9d-498e-a085-bc7c0109d373 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:40.854162 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-64441893-0e9d-498e-a085-bc7c0109d373 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:40.854641 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-64441893-0e9d-498e-a085-bc7c0109d373 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:40.855082 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-64441893-0e9d-498e-a085-bc7c0109d373 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:40.855788 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-64441893-0e9d-498e-a085-bc7c0109d373 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:40.856240 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-64441893-0e9d-498e-a085-bc7c0109d373 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:40.856661 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-64441893-0e9d-498e-a085-bc7c0109d373 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:40.882889 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-64441893-0e9d-498e-a085-bc7c0109d373 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Going to try to terminate instance {{(pid=127542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:54:41.124845 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:41.269937 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-64441893-0e9d-498e-a085-bc7c0109d373 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "DELETE /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 204 len: 0 microversion: 2.1 time: 0.417753 Oct 03 12:54:41.269937 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 296/591] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:54:40 2022] DELETE /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:54:41.270162 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-cec02fd3-5d23-4c86-858b-b3c4a716a657 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:41.270597 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-cec02fd3-5d23-4c86-858b-b3c4a716a657 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:41.277100 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cec02fd3-5d23-4c86-858b-b3c4a716a657 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:41.277587 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cec02fd3-5d23-4c86-858b-b3c4a716a657 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:41.278026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cec02fd3-5d23-4c86-858b-b3c4a716a657 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:41.278808 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cec02fd3-5d23-4c86-858b-b3c4a716a657 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:41.279271 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cec02fd3-5d23-4c86-858b-b3c4a716a657 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:41.279725 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cec02fd3-5d23-4c86-858b-b3c4a716a657 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:41.415995 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-cec02fd3-5d23-4c86-858b-b3c4a716a657 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:41.423832 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-cec02fd3-5d23-4c86-858b-b3c4a716a657 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1690 microversion: 2.1 time: 0.157854 Oct 03 12:54:41.424399 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 296/592] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:41 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:41.482606 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-67e1a660-dc28-4f30-8227-ffcef77c1024 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:41.483339 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-67e1a660-dc28-4f30-8227-ffcef77c1024 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:41.489740 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-67e1a660-dc28-4f30-8227-ffcef77c1024 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:41.490238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-67e1a660-dc28-4f30-8227-ffcef77c1024 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:41.490675 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-67e1a660-dc28-4f30-8227-ffcef77c1024 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:41.492236 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-67e1a660-dc28-4f30-8227-ffcef77c1024 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:41.492752 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-67e1a660-dc28-4f30-8227-ffcef77c1024 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:41.493180 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-67e1a660-dc28-4f30-8227-ffcef77c1024 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:41.628275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-67e1a660-dc28-4f30-8227-ffcef77c1024 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:41.637122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-67e1a660-dc28-4f30-8227-ffcef77c1024 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1362 microversion: 2.1 time: 0.158743 Oct 03 12:54:41.638124 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 297/593] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:41 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:42.448347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-57826fec-db56-4569-97bf-af7ffbbb6957 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:42.448954 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-57826fec-db56-4569-97bf-af7ffbbb6957 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:42.454888 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-57826fec-db56-4569-97bf-af7ffbbb6957 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:42.455393 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-57826fec-db56-4569-97bf-af7ffbbb6957 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:42.455835 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-57826fec-db56-4569-97bf-af7ffbbb6957 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:42.456520 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-57826fec-db56-4569-97bf-af7ffbbb6957 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:42.456969 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-57826fec-db56-4569-97bf-af7ffbbb6957 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:42.457390 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-57826fec-db56-4569-97bf-af7ffbbb6957 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:42.587868 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-57826fec-db56-4569-97bf-af7ffbbb6957 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:42.595768 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-57826fec-db56-4569-97bf-af7ffbbb6957 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1690 microversion: 2.1 time: 0.152132 Oct 03 12:54:42.596364 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 297/594] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:42 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:42.663275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-735186d2-c640-4d3d-a638-abeef9acec93 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:42.664049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-735186d2-c640-4d3d-a638-abeef9acec93 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:42.670586 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-735186d2-c640-4d3d-a638-abeef9acec93 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:42.671071 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-735186d2-c640-4d3d-a638-abeef9acec93 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:42.671548 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-735186d2-c640-4d3d-a638-abeef9acec93 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:42.672233 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-735186d2-c640-4d3d-a638-abeef9acec93 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:42.672687 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-735186d2-c640-4d3d-a638-abeef9acec93 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:42.673111 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-735186d2-c640-4d3d-a638-abeef9acec93 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:42.802611 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-735186d2-c640-4d3d-a638-abeef9acec93 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:42.810311 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-735186d2-c640-4d3d-a638-abeef9acec93 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1362 microversion: 2.1 time: 0.150869 Oct 03 12:54:42.810882 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 298/595] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:42 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:43.357798 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-fcab37d3-427d-4abb-a92d-6dc7485667f1 req-9fa1233f-00e2-4b8f-a6c8-75ff6b51ef62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a5c967-4163-4841-ae8c-77d508c0ff59", "name": "network-vif-plugged", "status": "completed", "tag": "cf688afb-8bbc-40e1-934b-cdf7069fca35"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:54:43.362706 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=2 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:43.363397 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=12 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:43.365139 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:43.369759 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-fcab37d3-427d-4abb-a92d-6dc7485667f1 req-9fa1233f-00e2-4b8f-a6c8-75ff6b51ef62 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:43.370236 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-fcab37d3-427d-4abb-a92d-6dc7485667f1 req-9fa1233f-00e2-4b8f-a6c8-75ff6b51ef62 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:43.370664 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-fcab37d3-427d-4abb-a92d-6dc7485667f1 req-9fa1233f-00e2-4b8f-a6c8-75ff6b51ef62 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:43.381310 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-fcab37d3-427d-4abb-a92d-6dc7485667f1 req-9fa1233f-00e2-4b8f-a6c8-75ff6b51ef62 service nova] Creating event network-vif-plugged:cf688afb-8bbc-40e1-934b-cdf7069fca35 for instance 03a5c967-4163-4841-ae8c-77d508c0ff59 on hv-cinder-84456 Oct 03 12:54:43.386132 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-fcab37d3-427d-4abb-a92d-6dc7485667f1 req-9fa1233f-00e2-4b8f-a6c8-75ff6b51ef62 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032061 Oct 03 12:54:43.386704 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 298/596] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:54:43.620106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-6b85f6e9-d821-418c-a114-f1d3ebc15ea2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:43.620718 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-6b85f6e9-d821-418c-a114-f1d3ebc15ea2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:43.622561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=12 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:43.627512 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b85f6e9-d821-418c-a114-f1d3ebc15ea2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:43.627998 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b85f6e9-d821-418c-a114-f1d3ebc15ea2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:43.628432 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b85f6e9-d821-418c-a114-f1d3ebc15ea2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:43.629116 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b85f6e9-d821-418c-a114-f1d3ebc15ea2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:43.629572 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b85f6e9-d821-418c-a114-f1d3ebc15ea2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:43.630001 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b85f6e9-d821-418c-a114-f1d3ebc15ea2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:43.758773 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6b85f6e9-d821-418c-a114-f1d3ebc15ea2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:43.766431 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-6b85f6e9-d821-418c-a114-f1d3ebc15ea2 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1690 microversion: 2.1 time: 0.151231 Oct 03 12:54:43.766994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 299/597] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:43 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:43.835230 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-10737cf4-ab5d-432d-b76a-c3463ec6c151 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:43.835952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-10737cf4-ab5d-432d-b76a-c3463ec6c151 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:43.843173 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-10737cf4-ab5d-432d-b76a-c3463ec6c151 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:43.843682 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-10737cf4-ab5d-432d-b76a-c3463ec6c151 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:43.844121 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-10737cf4-ab5d-432d-b76a-c3463ec6c151 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:43.844811 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-10737cf4-ab5d-432d-b76a-c3463ec6c151 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:43.845266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-10737cf4-ab5d-432d-b76a-c3463ec6c151 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:43.845692 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-10737cf4-ab5d-432d-b76a-c3463ec6c151 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:43.974681 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-10737cf4-ab5d-432d-b76a-c3463ec6c151 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:43.982381 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-10737cf4-ab5d-432d-b76a-c3463ec6c151 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1362 microversion: 2.1 time: 0.152536 Oct 03 12:54:43.982952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 299/598] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:43 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:44.790043 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-2c32bbd1-ae2a-4427-8c43-b81da01689c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:44.790686 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-2c32bbd1-ae2a-4427-8c43-b81da01689c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:44.797087 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2c32bbd1-ae2a-4427-8c43-b81da01689c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:44.797574 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2c32bbd1-ae2a-4427-8c43-b81da01689c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:44.798014 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2c32bbd1-ae2a-4427-8c43-b81da01689c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:44.798793 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2c32bbd1-ae2a-4427-8c43-b81da01689c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:44.799254 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2c32bbd1-ae2a-4427-8c43-b81da01689c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:44.799711 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2c32bbd1-ae2a-4427-8c43-b81da01689c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:44.929496 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-2c32bbd1-ae2a-4427-8c43-b81da01689c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:44.937245 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-2c32bbd1-ae2a-4427-8c43-b81da01689c9 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1690 microversion: 2.1 time: 0.151757 Oct 03 12:54:44.937808 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 300/599] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:44 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:45.010171 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-95f62733-581a-4d62-a88f-76774874676a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:45.010804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-95f62733-581a-4d62-a88f-76774874676a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:45.017853 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-95f62733-581a-4d62-a88f-76774874676a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:45.018342 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-95f62733-581a-4d62-a88f-76774874676a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:45.018777 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-95f62733-581a-4d62-a88f-76774874676a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:45.019543 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-95f62733-581a-4d62-a88f-76774874676a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:45.019997 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-95f62733-581a-4d62-a88f-76774874676a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:45.020420 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-95f62733-581a-4d62-a88f-76774874676a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:45.153847 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-95f62733-581a-4d62-a88f-76774874676a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:45.161337 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-95f62733-581a-4d62-a88f-76774874676a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1362 microversion: 2.1 time: 0.158085 Oct 03 12:54:45.161898 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 300/600] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:45 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:45.544809 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-5f248c08-d8ab-45ad-925a-24e9cef3c591 req-ab59ee50-6d78-4f4f-b62b-ef9bb12f82f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d3f4ae-60a5-4463-9a02-00d846d22289", "name": "network-vif-deleted", "tag": "99141c24-9fad-4cf8-9d13-c4d90e5ddd88"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:54:45.555249 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-5f248c08-d8ab-45ad-925a-24e9cef3c591 req-ab59ee50-6d78-4f4f-b62b-ef9bb12f82f0 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:45.555783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-5f248c08-d8ab-45ad-925a-24e9cef3c591 req-ab59ee50-6d78-4f4f-b62b-ef9bb12f82f0 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:45.556220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-5f248c08-d8ab-45ad-925a-24e9cef3c591 req-ab59ee50-6d78-4f4f-b62b-ef9bb12f82f0 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:45.568224 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-5f248c08-d8ab-45ad-925a-24e9cef3c591 req-ab59ee50-6d78-4f4f-b62b-ef9bb12f82f0 service nova] Creating event network-vif-deleted:99141c24-9fad-4cf8-9d13-c4d90e5ddd88 for instance 85d3f4ae-60a5-4463-9a02-00d846d22289 on hv-cinder-84456 Oct 03 12:54:45.574268 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-5f248c08-d8ab-45ad-925a-24e9cef3c591 req-ab59ee50-6d78-4f4f-b62b-ef9bb12f82f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032952 Oct 03 12:54:45.575002 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 301/601] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:54:45.961328 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9d288664-9228-4de1-a919-339bc853b4af tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:45.972012 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-9d288664-9228-4de1-a919-339bc853b4af tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:45.972012 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d288664-9228-4de1-a919-339bc853b4af tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:45.972012 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d288664-9228-4de1-a919-339bc853b4af tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:45.972012 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d288664-9228-4de1-a919-339bc853b4af tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:45.972869 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d288664-9228-4de1-a919-339bc853b4af tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:45.972869 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d288664-9228-4de1-a919-339bc853b4af tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:45.972869 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d288664-9228-4de1-a919-339bc853b4af tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:46.002643 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d288664-9228-4de1-a919-339bc853b4af tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:46.003155 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d288664-9228-4de1-a919-339bc853b4af tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:46.003616 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d288664-9228-4de1-a919-339bc853b4af tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:46.004064 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-9d288664-9228-4de1-a919-339bc853b4af tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lazy-loading 'fault' on Instance uuid 85d3f4ae-60a5-4463-9a02-00d846d22289 {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:54:46.044893 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9d288664-9228-4de1-a919-339bc853b4af tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:46.052771 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-9d288664-9228-4de1-a919-339bc853b4af tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1334 microversion: 2.1 time: 0.096050 Oct 03 12:54:46.057481 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 301/602] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:45 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1334 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:46.186303 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a18e37c9-8d94-44d8-a50e-f6ab96238364 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:46.186918 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a18e37c9-8d94-44d8-a50e-f6ab96238364 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:46.193022 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a18e37c9-8d94-44d8-a50e-f6ab96238364 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:46.193504 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a18e37c9-8d94-44d8-a50e-f6ab96238364 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:46.193937 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a18e37c9-8d94-44d8-a50e-f6ab96238364 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:46.195452 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a18e37c9-8d94-44d8-a50e-f6ab96238364 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:46.195969 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a18e37c9-8d94-44d8-a50e-f6ab96238364 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:46.196394 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a18e37c9-8d94-44d8-a50e-f6ab96238364 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:46.347537 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a18e37c9-8d94-44d8-a50e-f6ab96238364 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:46.356653 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a18e37c9-8d94-44d8-a50e-f6ab96238364 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1548 microversion: 2.1 time: 0.175156 Oct 03 12:54:46.357575 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 302/603] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:46 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:46.379876 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-368218a4-d8c4-4eab-b7ab-432edd6c0de6 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:46.380374 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-368218a4-d8c4-4eab-b7ab-432edd6c0de6 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:46.386394 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-368218a4-d8c4-4eab-b7ab-432edd6c0de6 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:46.386872 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-368218a4-d8c4-4eab-b7ab-432edd6c0de6 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:46.387306 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-368218a4-d8c4-4eab-b7ab-432edd6c0de6 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:46.388071 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-368218a4-d8c4-4eab-b7ab-432edd6c0de6 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:46.388529 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-368218a4-d8c4-4eab-b7ab-432edd6c0de6 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:46.388954 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-368218a4-d8c4-4eab-b7ab-432edd6c0de6 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:46.478489 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-368218a4-d8c4-4eab-b7ab-432edd6c0de6 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102399 Oct 03 12:54:46.483400 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 302/604] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Oct 3 12:54:46 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:54:47.076258 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f7950097-e240-4e02-9205-35eda6e264c4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:47.076986 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f7950097-e240-4e02-9205-35eda6e264c4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:47.083237 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f7950097-e240-4e02-9205-35eda6e264c4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:47.083758 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f7950097-e240-4e02-9205-35eda6e264c4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:47.084200 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f7950097-e240-4e02-9205-35eda6e264c4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:47.084954 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f7950097-e240-4e02-9205-35eda6e264c4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:47.085551 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f7950097-e240-4e02-9205-35eda6e264c4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:47.086445 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f7950097-e240-4e02-9205-35eda6e264c4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:47.119894 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f7950097-e240-4e02-9205-35eda6e264c4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:47.120949 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f7950097-e240-4e02-9205-35eda6e264c4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:47.121477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f7950097-e240-4e02-9205-35eda6e264c4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:47.121924 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-f7950097-e240-4e02-9205-35eda6e264c4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lazy-loading 'fault' on Instance uuid 85d3f4ae-60a5-4463-9a02-00d846d22289 {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:54:47.165494 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-f7950097-e240-4e02-9205-35eda6e264c4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:47.170120 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:47.174554 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f7950097-e240-4e02-9205-35eda6e264c4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 200 len: 1334 microversion: 2.1 time: 0.102124 Oct 03 12:54:47.175145 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 303/605] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:47 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 1334 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:47.595090 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-30ed5db8-4f03-4212-a5f5-192401e94340 req-75434782-56e4-4351-ba1a-1cd8753d15d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03a5c967-4163-4841-ae8c-77d508c0ff59", "tag": "cf688afb-8bbc-40e1-934b-cdf7069fca35"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:54:47.606208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-30ed5db8-4f03-4212-a5f5-192401e94340 req-75434782-56e4-4351-ba1a-1cd8753d15d5 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:47.606831 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-30ed5db8-4f03-4212-a5f5-192401e94340 req-75434782-56e4-4351-ba1a-1cd8753d15d5 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:47.607271 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-30ed5db8-4f03-4212-a5f5-192401e94340 req-75434782-56e4-4351-ba1a-1cd8753d15d5 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:47.622538 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-30ed5db8-4f03-4212-a5f5-192401e94340 req-75434782-56e4-4351-ba1a-1cd8753d15d5 service nova] Creating event network-changed:cf688afb-8bbc-40e1-934b-cdf7069fca35 for instance 03a5c967-4163-4841-ae8c-77d508c0ff59 on hv-cinder-84456 Oct 03 12:54:47.630429 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-30ed5db8-4f03-4212-a5f5-192401e94340 req-75434782-56e4-4351-ba1a-1cd8753d15d5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039989 Oct 03 12:54:47.631240 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 303/606] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:54:48.199242 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1cc0266f-664e-432e-a1e6-d852e1570ded tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:48.200115 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-1cc0266f-664e-432e-a1e6-d852e1570ded tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 85d3f4ae-60a5-4463-9a02-00d846d22289] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:48.208058 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1cc0266f-664e-432e-a1e6-d852e1570ded tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:48.209045 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1cc0266f-664e-432e-a1e6-d852e1570ded tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:48.209598 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1cc0266f-664e-432e-a1e6-d852e1570ded tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:48.211223 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1cc0266f-664e-432e-a1e6-d852e1570ded tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:48.211827 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1cc0266f-664e-432e-a1e6-d852e1570ded tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:48.212361 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1cc0266f-664e-432e-a1e6-d852e1570ded tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-1cc0266f-664e-432e-a1e6-d852e1570ded tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] HTTP exception thrown: Instance 85d3f4ae-60a5-4463-9a02-00d846d22289 could not be found. Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1cc0266f-664e-432e-a1e6-d852e1570ded tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Request method failure captured: Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 HTTP/1.1 Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtpg_jSSVskjPk1vj2hB6kFIFqzmNhwYwmbqVtDtVEm_DCGqJp2bI-HTYHdXoVGxmBUvfojEda8t7ahZxu3oZUxrCi0M81LTwRQ1oj9rh78tD7KDuQLShxe9wj1rzH1fQcVA6c-lh1vZH84HHzjmTQfelEBPR3ibYOhBaZo555opZQM Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 3f2b18d217d14d39886718cf209eb576 Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103094266 Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:54:48.239046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:54:48.240746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f2b18d217d14d39886718cf209eb576"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f2b18d217d14d39886718cf209eb576"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f2b18d217d14d39886718cf209eb576"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f2b18d217d14d39886718cf209eb576"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:54:48.240746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103094266 Oct 03 12:54:48.240746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 3f2b18d217d14d39886718cf209eb576 Oct 03 12:54:48.240746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103094266 Oct 03 12:54:48.240746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-ServerRescueNegativeTestJSON-1103094266-project Oct 03 12:54:48.240746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:54:48.240746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:54:48.240746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: ad5654cfa65f4cfa9e68832b9cd3d129 Oct 03 12:54:48.240746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103094266-project Oct 03 12:54:48.240746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:54:48.240746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance 85d3f4ae-60a5-4463-9a02-00d846d22289 could not be found. Oct 03 12:54:48.240746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': '85d3f4ae-60a5-4463-9a02-00d846d22289'} Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d3f4ae-60a5-4463-9a02-00d846d22289 could not be found. Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:54:48.242556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d3f4ae-60a5-4463-9a02-00d846d22289 could not be found. Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d3f4ae-60a5-4463-9a02-00d846d22289 could not be found. Oct 03 12:54:48.244049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:54:48.245335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1cc0266f-664e-432e-a1e6-d852e1570ded tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Returning 404 to user: Instance 85d3f4ae-60a5-4463-9a02-00d846d22289 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:54:48.245335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-1cc0266f-664e-432e-a1e6-d852e1570ded tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289" status: 404 len: 111 microversion: 2.1 time: 0.037152 Oct 03 12:54:48.245335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 304/607] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:48 2022] GET /compute/v2.1/servers/85d3f4ae-60a5-4463-9a02-00d846d22289 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:54:48.245601 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e70a7c03-de67-4332-ac47-f5b6f37cca70 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '.version_select at 0x7fc740176700>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:48.362566 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e70a7c03-de67-4332-ac47-f5b6f37cca70 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762024792" status: 202 len: 0 microversion: 2.1 time: 0.125769 Oct 03 12:54:48.363331 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 304/608] 10.222.0.33 () {58 vars in 1221 bytes} [Mon Oct 3 12:54:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762024792 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:54:51.898182 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c0cf0ad9-29b7-4bc1-9c67-cf3390e712d5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:51.898710 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c0cf0ad9-29b7-4bc1-9c67-cf3390e712d5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:51.905862 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c0cf0ad9-29b7-4bc1-9c67-cf3390e712d5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:51.906340 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c0cf0ad9-29b7-4bc1-9c67-cf3390e712d5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:51.906772 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c0cf0ad9-29b7-4bc1-9c67-cf3390e712d5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:51.912177 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c0cf0ad9-29b7-4bc1-9c67-cf3390e712d5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:51.913349 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c0cf0ad9-29b7-4bc1-9c67-cf3390e712d5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:51.914018 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c0cf0ad9-29b7-4bc1-9c67-cf3390e712d5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:51.941513 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c0cf0ad9-29b7-4bc1-9c67-cf3390e712d5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Going to try to terminate instance {{(pid=127542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:54:52.254877 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c0cf0ad9-29b7-4bc1-9c67-cf3390e712d5 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "DELETE /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 204 len: 0 microversion: 2.1 time: 0.360209 Oct 03 12:54:52.255498 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 305/609] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:54:51 2022] DELETE /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:54:52.266605 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-24ce46f8-45b3-461c-bd0b-c05e793115b0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:52.271859 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-24ce46f8-45b3-461c-bd0b-c05e793115b0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:52.275600 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24ce46f8-45b3-461c-bd0b-c05e793115b0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:52.276081 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24ce46f8-45b3-461c-bd0b-c05e793115b0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:52.276514 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24ce46f8-45b3-461c-bd0b-c05e793115b0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:52.277205 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24ce46f8-45b3-461c-bd0b-c05e793115b0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:52.277655 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24ce46f8-45b3-461c-bd0b-c05e793115b0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:52.278125 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24ce46f8-45b3-461c-bd0b-c05e793115b0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:52.420974 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-24ce46f8-45b3-461c-bd0b-c05e793115b0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:52.429084 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-24ce46f8-45b3-461c-bd0b-c05e793115b0 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1507 microversion: 2.1 time: 0.168542 Oct 03 12:54:52.429646 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 305/610] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:52 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:53.453381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-bd9780f7-7938-46a2-9adb-12d756cb9f87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:53.454085 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-bd9780f7-7938-46a2-9adb-12d756cb9f87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:53.461247 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bd9780f7-7938-46a2-9adb-12d756cb9f87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:53.461729 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bd9780f7-7938-46a2-9adb-12d756cb9f87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:53.462168 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bd9780f7-7938-46a2-9adb-12d756cb9f87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:53.462861 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bd9780f7-7938-46a2-9adb-12d756cb9f87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:53.463335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bd9780f7-7938-46a2-9adb-12d756cb9f87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:53.463771 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bd9780f7-7938-46a2-9adb-12d756cb9f87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:53.590662 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-bd9780f7-7938-46a2-9adb-12d756cb9f87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:53.598553 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-bd9780f7-7938-46a2-9adb-12d756cb9f87 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1507 microversion: 2.1 time: 0.149482 Oct 03 12:54:53.599113 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 306/611] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:53 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:54.622717 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-dde044e1-dd6b-4c5a-b816-7fd39666db96 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:54.623258 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-dde044e1-dd6b-4c5a-b816-7fd39666db96 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:54.629879 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dde044e1-dd6b-4c5a-b816-7fd39666db96 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:54.630364 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dde044e1-dd6b-4c5a-b816-7fd39666db96 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:54.630797 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dde044e1-dd6b-4c5a-b816-7fd39666db96 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:54.631559 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dde044e1-dd6b-4c5a-b816-7fd39666db96 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:54.632008 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dde044e1-dd6b-4c5a-b816-7fd39666db96 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:54.632455 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dde044e1-dd6b-4c5a-b816-7fd39666db96 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:54.767424 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-dde044e1-dd6b-4c5a-b816-7fd39666db96 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:54.775502 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-dde044e1-dd6b-4c5a-b816-7fd39666db96 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1507 microversion: 2.1 time: 0.156742 Oct 03 12:54:54.784992 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 306/612] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:54 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:55.272251 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-6ebeac52-75f6-47bd-aaaa-0f5b24cf7184 req-103f00f1-3c40-4f18-9e96-6b0bcf1e3ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c20240-a307-4c2f-8121-6150803fef0c", "name": "network-vif-deleted", "tag": "c20f6694-be45-4085-a244-f2e7042c5197"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:54:55.282459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-6ebeac52-75f6-47bd-aaaa-0f5b24cf7184 req-103f00f1-3c40-4f18-9e96-6b0bcf1e3ba9 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:55.282946 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-6ebeac52-75f6-47bd-aaaa-0f5b24cf7184 req-103f00f1-3c40-4f18-9e96-6b0bcf1e3ba9 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:55.283412 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-6ebeac52-75f6-47bd-aaaa-0f5b24cf7184 req-103f00f1-3c40-4f18-9e96-6b0bcf1e3ba9 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:55.294310 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-6ebeac52-75f6-47bd-aaaa-0f5b24cf7184 req-103f00f1-3c40-4f18-9e96-6b0bcf1e3ba9 service nova] Creating event network-vif-deleted:c20f6694-be45-4085-a244-f2e7042c5197 for instance 89c20240-a307-4c2f-8121-6150803fef0c on hv-cinder-84456 Oct 03 12:54:55.299212 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-6ebeac52-75f6-47bd-aaaa-0f5b24cf7184 req-103f00f1-3c40-4f18-9e96-6b0bcf1e3ba9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030708 Oct 03 12:54:55.299840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 307/613] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:54:55.799025 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-12ed8395-404e-4381-86d8-14d20b555710 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:55.799628 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-12ed8395-404e-4381-86d8-14d20b555710 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:55.806009 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-12ed8395-404e-4381-86d8-14d20b555710 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:55.806498 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-12ed8395-404e-4381-86d8-14d20b555710 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:55.806933 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-12ed8395-404e-4381-86d8-14d20b555710 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:55.807657 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-12ed8395-404e-4381-86d8-14d20b555710 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:55.808117 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-12ed8395-404e-4381-86d8-14d20b555710 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:55.808553 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-12ed8395-404e-4381-86d8-14d20b555710 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:55.840179 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-12ed8395-404e-4381-86d8-14d20b555710 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:55.840610 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-12ed8395-404e-4381-86d8-14d20b555710 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:55.841049 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-12ed8395-404e-4381-86d8-14d20b555710 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:55.841497 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-12ed8395-404e-4381-86d8-14d20b555710 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lazy-loading 'fault' on Instance uuid 89c20240-a307-4c2f-8121-6150803fef0c {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:54:55.882566 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-12ed8395-404e-4381-86d8-14d20b555710 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:55.886361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=100 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:55.891001 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-12ed8395-404e-4381-86d8-14d20b555710 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 200 len: 1311 microversion: 2.1 time: 0.096065 Oct 03 12:54:55.891600 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 307/614] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:55 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:56.915997 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ae7e1e98-ab03-4b04-8c78-0c6966cae79b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:56.916711 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-ae7e1e98-ab03-4b04-8c78-0c6966cae79b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: 89c20240-a307-4c2f-8121-6150803fef0c] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:56.923029 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae7e1e98-ab03-4b04-8c78-0c6966cae79b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:56.923561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae7e1e98-ab03-4b04-8c78-0c6966cae79b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:56.924009 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae7e1e98-ab03-4b04-8c78-0c6966cae79b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:56.924707 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae7e1e98-ab03-4b04-8c78-0c6966cae79b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:56.925177 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae7e1e98-ab03-4b04-8c78-0c6966cae79b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:56.925607 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae7e1e98-ab03-4b04-8c78-0c6966cae79b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:56.941823 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-ae7e1e98-ab03-4b04-8c78-0c6966cae79b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] HTTP exception thrown: Instance 89c20240-a307-4c2f-8121-6150803fef0c could not be found. Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ae7e1e98-ab03-4b04-8c78-0c6966cae79b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Request method failure captured: Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c HTTP/1.1 Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtpg_jSSVskjPk1vj2hB6kFIFqzmNhwYwmbqVtDtVEm_DCGqJp2bI-HTYHdXoVGxmBUvfojEda8t7ahZxu3oZUxrCi0M81LTwRQ1oj9rh78tD7KDuQLShxe9wj1rzH1fQcVA6c-lh1vZH84HHzjmTQfelEBPR3ibYOhBaZo555opZQM Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 3f2b18d217d14d39886718cf209eb576 Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103094266 Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:54:56.943488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:54:56.956315 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f2b18d217d14d39886718cf209eb576"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f2b18d217d14d39886718cf209eb576"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f2b18d217d14d39886718cf209eb576"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f2b18d217d14d39886718cf209eb576"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:54:56.956315 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103094266 Oct 03 12:54:56.956315 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 3f2b18d217d14d39886718cf209eb576 Oct 03 12:54:56.956315 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103094266 Oct 03 12:54:56.956315 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-ServerRescueNegativeTestJSON-1103094266-project Oct 03 12:54:56.956315 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:54:56.956315 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:54:56.956315 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: ad5654cfa65f4cfa9e68832b9cd3d129 Oct 03 12:54:56.956315 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103094266-project Oct 03 12:54:56.956315 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:54:56.956315 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance 89c20240-a307-4c2f-8121-6150803fef0c could not be found. Oct 03 12:54:56.956315 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': '89c20240-a307-4c2f-8121-6150803fef0c'} Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c20240-a307-4c2f-8121-6150803fef0c could not be found. Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:54:56.957286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c20240-a307-4c2f-8121-6150803fef0c could not be found. Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c20240-a307-4c2f-8121-6150803fef0c could not be found. Oct 03 12:54:56.959330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:54:56.960822 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ae7e1e98-ab03-4b04-8c78-0c6966cae79b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Returning 404 to user: Instance 89c20240-a307-4c2f-8121-6150803fef0c could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:54:56.960822 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-ae7e1e98-ab03-4b04-8c78-0c6966cae79b tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c" status: 404 len: 111 microversion: 2.1 time: 0.035138 Oct 03 12:54:56.960822 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 308/615] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:56 2022] GET /compute/v2.1/servers/89c20240-a307-4c2f-8121-6150803fef0c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:54:56.961187 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b2385075-2a90-44a9-8435-f8a288b929f7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:56.961187 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-b2385075-2a90-44a9-8435-f8a288b929f7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:56.961864 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b2385075-2a90-44a9-8435-f8a288b929f7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:56.962111 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b2385075-2a90-44a9-8435-f8a288b929f7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:56.962545 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b2385075-2a90-44a9-8435-f8a288b929f7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:56.963234 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b2385075-2a90-44a9-8435-f8a288b929f7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:56.963713 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b2385075-2a90-44a9-8435-f8a288b929f7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:56.964132 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b2385075-2a90-44a9-8435-f8a288b929f7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:56.991943 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-b2385075-2a90-44a9-8435-f8a288b929f7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Going to try to terminate instance {{(pid=127544) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:54:57.246237 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-b2385075-2a90-44a9-8435-f8a288b929f7 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 204 len: 0 microversion: 2.1 time: 0.295553 Oct 03 12:54:57.246989 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 308/616] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:54:56 2022] DELETE /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 12:54:57.254939 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-db7bd14c-96ef-4294-bc7c-9b8af18dc76e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:57.255594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-db7bd14c-96ef-4294-bc7c-9b8af18dc76e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:57.261652 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-db7bd14c-96ef-4294-bc7c-9b8af18dc76e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:57.262142 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-db7bd14c-96ef-4294-bc7c-9b8af18dc76e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:57.262577 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-db7bd14c-96ef-4294-bc7c-9b8af18dc76e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:57.263276 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-db7bd14c-96ef-4294-bc7c-9b8af18dc76e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:57.263764 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-db7bd14c-96ef-4294-bc7c-9b8af18dc76e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:57.264192 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-db7bd14c-96ef-4294-bc7c-9b8af18dc76e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:57.398215 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-db7bd14c-96ef-4294-bc7c-9b8af18dc76e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:57.406083 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-db7bd14c-96ef-4294-bc7c-9b8af18dc76e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.155032 Oct 03 12:54:57.406689 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 309/617] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:57 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:58.430615 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-79739393-6d32-4b01-9d5d-b62f72ff5e0f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:58.431347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-79739393-6d32-4b01-9d5d-b62f72ff5e0f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:58.437788 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-79739393-6d32-4b01-9d5d-b62f72ff5e0f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:58.438270 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-79739393-6d32-4b01-9d5d-b62f72ff5e0f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:58.438705 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-79739393-6d32-4b01-9d5d-b62f72ff5e0f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:58.439509 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-79739393-6d32-4b01-9d5d-b62f72ff5e0f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:58.439972 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-79739393-6d32-4b01-9d5d-b62f72ff5e0f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:58.440397 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-79739393-6d32-4b01-9d5d-b62f72ff5e0f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:58.573495 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-79739393-6d32-4b01-9d5d-b62f72ff5e0f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:58.581154 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-79739393-6d32-4b01-9d5d-b62f72ff5e0f tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.155774 Oct 03 12:54:58.581726 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 309/618] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:58 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:54:59.606871 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-74cc484e-b251-4995-88eb-573b91c04ba4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:54:59.607520 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-74cc484e-b251-4995-88eb-573b91c04ba4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:54:59.614911 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-74cc484e-b251-4995-88eb-573b91c04ba4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:59.616512 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-74cc484e-b251-4995-88eb-573b91c04ba4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:59.617195 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-74cc484e-b251-4995-88eb-573b91c04ba4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:59.617950 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-74cc484e-b251-4995-88eb-573b91c04ba4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:54:59.618480 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-74cc484e-b251-4995-88eb-573b91c04ba4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:54:59.619088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-74cc484e-b251-4995-88eb-573b91c04ba4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:54:59.755909 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-74cc484e-b251-4995-88eb-573b91c04ba4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:54:59.763527 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-74cc484e-b251-4995-88eb-573b91c04ba4 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.161525 Oct 03 12:54:59.764091 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 310/619] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:54:59 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:00.786575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-109d8b2c-1ca0-46ed-9189-121d93051f49 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:00.787189 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-109d8b2c-1ca0-46ed-9189-121d93051f49 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:00.794282 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-109d8b2c-1ca0-46ed-9189-121d93051f49 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:00.794752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-109d8b2c-1ca0-46ed-9189-121d93051f49 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:00.795194 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-109d8b2c-1ca0-46ed-9189-121d93051f49 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:00.795909 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-109d8b2c-1ca0-46ed-9189-121d93051f49 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:00.796365 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-109d8b2c-1ca0-46ed-9189-121d93051f49 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:00.796791 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-109d8b2c-1ca0-46ed-9189-121d93051f49 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:00.923858 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-109d8b2c-1ca0-46ed-9189-121d93051f49 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:00.932549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-109d8b2c-1ca0-46ed-9189-121d93051f49 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1522 microversion: 2.1 time: 0.149814 Oct 03 12:55:00.933122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 310/620] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:00 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:55:01.476689 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-7123df7a-ebd6-4435-9e0b-fef766e4c1da req-9696d4dc-fa7d-4e6f-826c-fb74e300ea0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9909a9d-feb5-4513-9e14-6aadc4e17c59", "name": "network-vif-deleted", "tag": "ca96c603-3295-4d37-99aa-2b5b95419166"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:01.487152 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-7123df7a-ebd6-4435-9e0b-fef766e4c1da req-9696d4dc-fa7d-4e6f-826c-fb74e300ea0e service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:01.487680 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-7123df7a-ebd6-4435-9e0b-fef766e4c1da req-9696d4dc-fa7d-4e6f-826c-fb74e300ea0e service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:01.488121 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-7123df7a-ebd6-4435-9e0b-fef766e4c1da req-9696d4dc-fa7d-4e6f-826c-fb74e300ea0e service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:01.500529 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-7123df7a-ebd6-4435-9e0b-fef766e4c1da req-9696d4dc-fa7d-4e6f-826c-fb74e300ea0e service nova] Creating event network-vif-deleted:ca96c603-3295-4d37-99aa-2b5b95419166 for instance f9909a9d-feb5-4513-9e14-6aadc4e17c59 on hv-cinder-84456 Oct 03 12:55:01.505306 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-7123df7a-ebd6-4435-9e0b-fef766e4c1da req-9696d4dc-fa7d-4e6f-826c-fb74e300ea0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091670 Oct 03 12:55:01.505919 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 311/621] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:55:01.954800 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-5025431d-180c-4307-9002-b6ba8a2d6250 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:01.955409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-5025431d-180c-4307-9002-b6ba8a2d6250 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:01.961748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5025431d-180c-4307-9002-b6ba8a2d6250 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:01.962221 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5025431d-180c-4307-9002-b6ba8a2d6250 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:01.963968 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5025431d-180c-4307-9002-b6ba8a2d6250 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:01.963968 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5025431d-180c-4307-9002-b6ba8a2d6250 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:01.963968 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5025431d-180c-4307-9002-b6ba8a2d6250 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:01.964304 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5025431d-180c-4307-9002-b6ba8a2d6250 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:01.995100 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5025431d-180c-4307-9002-b6ba8a2d6250 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:01.995615 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5025431d-180c-4307-9002-b6ba8a2d6250 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:01.996057 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5025431d-180c-4307-9002-b6ba8a2d6250 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:01.996500 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-5025431d-180c-4307-9002-b6ba8a2d6250 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lazy-loading 'fault' on Instance uuid f9909a9d-feb5-4513-9e14-6aadc4e17c59 {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:55:02.039383 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5025431d-180c-4307-9002-b6ba8a2d6250 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5654cfa65f4cfa9e68832b9cd3d129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2b18d217d14d39886718cf209eb576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:02.047200 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-5025431d-180c-4307-9002-b6ba8a2d6250 tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 200 len: 1311 microversion: 2.1 time: 0.096196 Oct 03 12:55:02.047812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 311/622] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:01 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:03.071621 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-5f7bb666-39d8-49e3-ba05-82574f1bf33e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:03.072326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-5f7bb666-39d8-49e3-ba05-82574f1bf33e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] [instance: f9909a9d-feb5-4513-9e14-6aadc4e17c59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:03.078541 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5f7bb666-39d8-49e3-ba05-82574f1bf33e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:03.079031 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5f7bb666-39d8-49e3-ba05-82574f1bf33e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:03.079511 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5f7bb666-39d8-49e3-ba05-82574f1bf33e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:03.080241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5f7bb666-39d8-49e3-ba05-82574f1bf33e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:03.080745 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5f7bb666-39d8-49e3-ba05-82574f1bf33e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:03.081174 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5f7bb666-39d8-49e3-ba05-82574f1bf33e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:03.094850 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-5f7bb666-39d8-49e3-ba05-82574f1bf33e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] HTTP exception thrown: Instance f9909a9d-feb5-4513-9e14-6aadc4e17c59 could not be found. Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-5f7bb666-39d8-49e3-ba05-82574f1bf33e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Request method failure captured: Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 HTTP/1.1 Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtpg_jSSVskjPk1vj2hB6kFIFqzmNhwYwmbqVtDtVEm_DCGqJp2bI-HTYHdXoVGxmBUvfojEda8t7ahZxu3oZUxrCi0M81LTwRQ1oj9rh78tD7KDuQLShxe9wj1rzH1fQcVA6c-lh1vZH84HHzjmTQfelEBPR3ibYOhBaZo555opZQM Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 3f2b18d217d14d39886718cf209eb576 Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103094266 Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:55:03.096522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:55:03.097751 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f2b18d217d14d39886718cf209eb576"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f2b18d217d14d39886718cf209eb576"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f2b18d217d14d39886718cf209eb576"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f2b18d217d14d39886718cf209eb576"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:55:03.097751 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103094266 Oct 03 12:55:03.097751 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 3f2b18d217d14d39886718cf209eb576 Oct 03 12:55:03.097751 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103094266 Oct 03 12:55:03.097751 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-ServerRescueNegativeTestJSON-1103094266-project Oct 03 12:55:03.097751 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:55:03.097751 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:55:03.097751 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: ad5654cfa65f4cfa9e68832b9cd3d129 Oct 03 12:55:03.097751 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103094266-project Oct 03 12:55:03.097751 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:55:03.097751 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance f9909a9d-feb5-4513-9e14-6aadc4e17c59 could not be found. Oct 03 12:55:03.097751 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': 'f9909a9d-feb5-4513-9e14-6aadc4e17c59'} Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9909a9d-feb5-4513-9e14-6aadc4e17c59 could not be found. Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:55:03.098698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9909a9d-feb5-4513-9e14-6aadc4e17c59 could not be found. Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9909a9d-feb5-4513-9e14-6aadc4e17c59 could not be found. Oct 03 12:55:03.100762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:55:03.102268 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-5f7bb666-39d8-49e3-ba05-82574f1bf33e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] Returning 404 to user: Instance f9909a9d-feb5-4513-9e14-6aadc4e17c59 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:55:03.102268 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-5f7bb666-39d8-49e3-ba05-82574f1bf33e tempest-ServerRescueNegativeTestJSON-1103094266 tempest-ServerRescueNegativeTestJSON-1103094266-project] 10.222.0.33 "GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59" status: 404 len: 111 microversion: 2.1 time: 0.031558 Oct 03 12:55:03.102268 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 312/623] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:03 2022] GET /compute/v2.1/servers/f9909a9d-feb5-4513-9e14-6aadc4e17c59 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:55:16.029625 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:16.030595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:16.202879 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-1f9f671a-b858-4b51-a7ea-e798eaebd9f5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:16.203401 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-1f9f671a-b858-4b51-a7ea-e798eaebd9f5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:16.210302 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1f9f671a-b858-4b51-a7ea-e798eaebd9f5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:16.210788 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1f9f671a-b858-4b51-a7ea-e798eaebd9f5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:16.211229 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1f9f671a-b858-4b51-a7ea-e798eaebd9f5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:16.211938 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1f9f671a-b858-4b51-a7ea-e798eaebd9f5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:16.212391 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1f9f671a-b858-4b51-a7ea-e798eaebd9f5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:16.212815 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1f9f671a-b858-4b51-a7ea-e798eaebd9f5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:16.236372 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-1f9f671a-b858-4b51-a7ea-e798eaebd9f5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea/ips" status: 200 len: 153 microversion: 2.20 time: 0.211836 Oct 03 12:55:16.238242 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 312/624] 10.222.0.33 () {60 vars in 1289 bytes} [Mon Oct 3 12:55:16 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea/ips => generated 153 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:55:19.041139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c981eb64-5e5a-4e1d-96ff-60b6244b83c9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:19.041703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c981eb64-5e5a-4e1d-96ff-60b6244b83c9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:19.044456 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:19.045143 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:19.049981 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c981eb64-5e5a-4e1d-96ff-60b6244b83c9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:19.050466 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c981eb64-5e5a-4e1d-96ff-60b6244b83c9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:19.050903 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c981eb64-5e5a-4e1d-96ff-60b6244b83c9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:19.051723 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c981eb64-5e5a-4e1d-96ff-60b6244b83c9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:19.052187 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c981eb64-5e5a-4e1d-96ff-60b6244b83c9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:19.052658 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c981eb64-5e5a-4e1d-96ff-60b6244b83c9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:19.076859 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-c981eb64-5e5a-4e1d-96ff-60b6244b83c9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lazy-loading 'flavor' on Instance uuid 6b37dd24-5a6e-4898-8247-8e00786088ea {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:55:19.679535 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c981eb64-5e5a-4e1d-96ff-60b6244b83c9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "POST /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea/action" status: 202 len: 0 microversion: 2.20 time: 0.643093 Oct 03 12:55:19.680184 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 313/625] 10.222.0.33 () {62 vars in 1319 bytes} [Mon Oct 3 12:55:19 2022] POST /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea/action => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:55:19.689691 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e4f076b1-a239-4e1f-950d-94fe336bd9ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:19.695062 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-e4f076b1-a239-4e1f-950d-94fe336bd9ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:19.698235 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e4f076b1-a239-4e1f-950d-94fe336bd9ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:19.698723 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e4f076b1-a239-4e1f-950d-94fe336bd9ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:19.699196 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e4f076b1-a239-4e1f-950d-94fe336bd9ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:19.699928 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e4f076b1-a239-4e1f-950d-94fe336bd9ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:19.700419 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e4f076b1-a239-4e1f-950d-94fe336bd9ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:19.700843 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e4f076b1-a239-4e1f-950d-94fe336bd9ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:19.830025 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e4f076b1-a239-4e1f-950d-94fe336bd9ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:19.838813 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e4f076b1-a239-4e1f-950d-94fe336bd9ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:19.840282 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e4f076b1-a239-4e1f-950d-94fe336bd9ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:19.841503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e4f076b1-a239-4e1f-950d-94fe336bd9ed tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1725 microversion: 2.20 time: 0.155991 Oct 03 12:55:19.842056 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 313/626] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:19 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:20.867788 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-aa08869e-408c-4905-bdc7-41ea50c54ce5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:20.868503 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-aa08869e-408c-4905-bdc7-41ea50c54ce5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:20.874769 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aa08869e-408c-4905-bdc7-41ea50c54ce5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:20.875256 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aa08869e-408c-4905-bdc7-41ea50c54ce5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:20.875720 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aa08869e-408c-4905-bdc7-41ea50c54ce5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:20.876414 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aa08869e-408c-4905-bdc7-41ea50c54ce5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:20.876874 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aa08869e-408c-4905-bdc7-41ea50c54ce5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:20.877306 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-aa08869e-408c-4905-bdc7-41ea50c54ce5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:21.014840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-aa08869e-408c-4905-bdc7-41ea50c54ce5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:21.025607 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-aa08869e-408c-4905-bdc7-41ea50c54ce5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:21.027048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-aa08869e-408c-4905-bdc7-41ea50c54ce5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:21.028265 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-aa08869e-408c-4905-bdc7-41ea50c54ce5 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1725 microversion: 2.20 time: 0.165587 Oct 03 12:55:21.028846 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 314/627] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:20 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:22.053488 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-4169afe9-5555-4856-82e8-2d470fd9b190 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:22.054126 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-4169afe9-5555-4856-82e8-2d470fd9b190 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:22.060767 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4169afe9-5555-4856-82e8-2d470fd9b190 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:22.061258 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4169afe9-5555-4856-82e8-2d470fd9b190 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:22.061707 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4169afe9-5555-4856-82e8-2d470fd9b190 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:22.062527 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4169afe9-5555-4856-82e8-2d470fd9b190 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:22.062993 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4169afe9-5555-4856-82e8-2d470fd9b190 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:22.063470 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4169afe9-5555-4856-82e8-2d470fd9b190 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:22.193377 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4169afe9-5555-4856-82e8-2d470fd9b190 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:22.201492 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4169afe9-5555-4856-82e8-2d470fd9b190 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:22.202981 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4169afe9-5555-4856-82e8-2d470fd9b190 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:22.204259 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-4169afe9-5555-4856-82e8-2d470fd9b190 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1725 microversion: 2.20 time: 0.154756 Oct 03 12:55:22.204820 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 314/628] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:22 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:23.229997 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a82cb49b-9802-43ac-a075-730715c6900e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:23.230605 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a82cb49b-9802-43ac-a075-730715c6900e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:23.237435 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a82cb49b-9802-43ac-a075-730715c6900e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:23.237937 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a82cb49b-9802-43ac-a075-730715c6900e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:23.238377 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a82cb49b-9802-43ac-a075-730715c6900e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:23.239197 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a82cb49b-9802-43ac-a075-730715c6900e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:23.239677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a82cb49b-9802-43ac-a075-730715c6900e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:23.240802 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a82cb49b-9802-43ac-a075-730715c6900e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:23.375968 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a82cb49b-9802-43ac-a075-730715c6900e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:23.387234 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a82cb49b-9802-43ac-a075-730715c6900e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:23.388712 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a82cb49b-9802-43ac-a075-730715c6900e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:23.389928 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a82cb49b-9802-43ac-a075-730715c6900e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1725 microversion: 2.20 time: 0.163862 Oct 03 12:55:23.390574 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 315/629] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:23 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:23.944228 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ac54562e-d800-4715-b8f0-858d4ba65d85 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:23.944704 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ac54562e-d800-4715-b8f0-858d4ba65d85 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:23.950090 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ac54562e-d800-4715-b8f0-858d4ba65d85 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:23.950576 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ac54562e-d800-4715-b8f0-858d4ba65d85 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:23.951010 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ac54562e-d800-4715-b8f0-858d4ba65d85 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:23.951729 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ac54562e-d800-4715-b8f0-858d4ba65d85 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:23.952177 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ac54562e-d800-4715-b8f0-858d4ba65d85 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:23.952600 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ac54562e-d800-4715-b8f0-858d4ba65d85 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:23.985074 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ac54562e-d800-4715-b8f0-858d4ba65d85 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/ips" status: 200 len: 145 microversion: 2.1 time: 0.219360 Oct 03 12:55:23.985819 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 315/630] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 12:55:23 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/ips => generated 145 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:55:24.423030 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-11c4f77f-55f1-4826-a743-1861a743106d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:24.423030 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-11c4f77f-55f1-4826-a743-1861a743106d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:24.423030 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-11c4f77f-55f1-4826-a743-1861a743106d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:24.423030 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-11c4f77f-55f1-4826-a743-1861a743106d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:24.423922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-11c4f77f-55f1-4826-a743-1861a743106d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:24.423922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-11c4f77f-55f1-4826-a743-1861a743106d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:24.424281 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-11c4f77f-55f1-4826-a743-1861a743106d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:24.424740 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-11c4f77f-55f1-4826-a743-1861a743106d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:24.560420 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-11c4f77f-55f1-4826-a743-1861a743106d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:24.566088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-11c4f77f-55f1-4826-a743-1861a743106d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:24.567586 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-11c4f77f-55f1-4826-a743-1861a743106d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:24.569458 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-11c4f77f-55f1-4826-a743-1861a743106d tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1725 microversion: 2.20 time: 0.158045 Oct 03 12:55:24.570029 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 316/631] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:24 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:25.594340 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e3ff6068-e7c1-42b1-92dc-f2368c799f98 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:25.595000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-e3ff6068-e7c1-42b1-92dc-f2368c799f98 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:25.601418 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e3ff6068-e7c1-42b1-92dc-f2368c799f98 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:25.601959 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e3ff6068-e7c1-42b1-92dc-f2368c799f98 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:25.602368 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e3ff6068-e7c1-42b1-92dc-f2368c799f98 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:25.603052 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e3ff6068-e7c1-42b1-92dc-f2368c799f98 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:25.603541 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e3ff6068-e7c1-42b1-92dc-f2368c799f98 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:25.603963 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e3ff6068-e7c1-42b1-92dc-f2368c799f98 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:25.746887 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e3ff6068-e7c1-42b1-92dc-f2368c799f98 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:25.751584 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e987fa55-6f52-48b0-b8a9-e2b384e364d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c58c4303-ee69-495d-923a-e7f2b95ab921"}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:25.753938 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e987fa55-6f52-48b0-b8a9-e2b384e364d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:25.755346 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e3ff6068-e7c1-42b1-92dc-f2368c799f98 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:25.757385 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e3ff6068-e7c1-42b1-92dc-f2368c799f98 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:25.758536 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e3ff6068-e7c1-42b1-92dc-f2368c799f98 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1725 microversion: 2.20 time: 0.168068 Oct 03 12:55:25.759084 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 316/632] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:25 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:25.761155 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e987fa55-6f52-48b0-b8a9-e2b384e364d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:25.761648 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e987fa55-6f52-48b0-b8a9-e2b384e364d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:25.762111 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e987fa55-6f52-48b0-b8a9-e2b384e364d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:25.762784 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e987fa55-6f52-48b0-b8a9-e2b384e364d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:25.763234 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e987fa55-6f52-48b0-b8a9-e2b384e364d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:25.763692 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e987fa55-6f52-48b0-b8a9-e2b384e364d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:25.992414 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ff4b2244-3507-4e61-b082-c506a7a70ca8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:25.992908 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ff4b2244-3507-4e61-b082-c506a7a70ca8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:25.998635 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff4b2244-3507-4e61-b082-c506a7a70ca8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:25.999116 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff4b2244-3507-4e61-b082-c506a7a70ca8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:25.999635 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff4b2244-3507-4e61-b082-c506a7a70ca8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:26.000318 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff4b2244-3507-4e61-b082-c506a7a70ca8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:26.000768 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff4b2244-3507-4e61-b082-c506a7a70ca8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:26.001195 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ff4b2244-3507-4e61-b082-c506a7a70ca8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:26.028417 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ff4b2244-3507-4e61-b082-c506a7a70ca8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Going to try to terminate instance {{(pid=127544) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:55:26.408048 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ff4b2244-3507-4e61-b082-c506a7a70ca8 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "DELETE /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 204 len: 0 microversion: 2.1 time: 0.419972 Oct 03 12:55:26.409046 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 317/633] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:55:25 2022] DELETE /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 12:55:26.418442 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-cb4746e2-fd4d-417f-871d-71d861560563 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:26.419138 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-cb4746e2-fd4d-417f-871d-71d861560563 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:26.425000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb4746e2-fd4d-417f-871d-71d861560563 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:26.425493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb4746e2-fd4d-417f-871d-71d861560563 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:26.425939 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb4746e2-fd4d-417f-871d-71d861560563 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:26.426637 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb4746e2-fd4d-417f-871d-71d861560563 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:26.427100 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb4746e2-fd4d-417f-871d-71d861560563 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:26.428731 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cb4746e2-fd4d-417f-871d-71d861560563 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:26.563623 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-cb4746e2-fd4d-417f-871d-71d861560563 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:26.575958 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-cb4746e2-fd4d-417f-871d-71d861560563 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1576 microversion: 2.1 time: 0.161235 Oct 03 12:55:26.583125 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 318/634] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:26 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:55:26.586058 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e987fa55-6f52-48b0-b8a9-e2b384e364d4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "POST /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.838167 Oct 03 12:55:26.588191 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 317/635] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 12:55:25 2022] POST /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments => generated 194 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:55:26.784233 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-494ebd41-e2da-4ef8-ae0d-bc02c27e1304 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:26.784935 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-494ebd41-e2da-4ef8-ae0d-bc02c27e1304 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:26.791476 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-494ebd41-e2da-4ef8-ae0d-bc02c27e1304 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:26.791969 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-494ebd41-e2da-4ef8-ae0d-bc02c27e1304 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:26.792407 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-494ebd41-e2da-4ef8-ae0d-bc02c27e1304 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:26.793106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-494ebd41-e2da-4ef8-ae0d-bc02c27e1304 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:26.793561 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-494ebd41-e2da-4ef8-ae0d-bc02c27e1304 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:26.793992 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-494ebd41-e2da-4ef8-ae0d-bc02c27e1304 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:26.925267 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-494ebd41-e2da-4ef8-ae0d-bc02c27e1304 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:26.934306 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-494ebd41-e2da-4ef8-ae0d-bc02c27e1304 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:26.935872 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-494ebd41-e2da-4ef8-ae0d-bc02c27e1304 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:26.937041 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-494ebd41-e2da-4ef8-ae0d-bc02c27e1304 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1725 microversion: 2.20 time: 0.156684 Oct 03 12:55:26.937592 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 319/636] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:26 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:27.688520 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8affc6c1-3f77-4067-ac82-b05a708b4352 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:27.689297 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8affc6c1-3f77-4067-ac82-b05a708b4352 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:27.697635 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8affc6c1-3f77-4067-ac82-b05a708b4352 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:27.697635 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8affc6c1-3f77-4067-ac82-b05a708b4352 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:27.697635 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8affc6c1-3f77-4067-ac82-b05a708b4352 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:27.698324 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8affc6c1-3f77-4067-ac82-b05a708b4352 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:27.698793 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8affc6c1-3f77-4067-ac82-b05a708b4352 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:27.699219 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8affc6c1-3f77-4067-ac82-b05a708b4352 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:27.852614 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8affc6c1-3f77-4067-ac82-b05a708b4352 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:27.860344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8affc6c1-3f77-4067-ac82-b05a708b4352 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1576 microversion: 2.1 time: 0.176904 Oct 03 12:55:27.860909 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 318/637] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:27 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:27.963661 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d9dabceb-8e14-44bf-86ce-6821e339f0e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:27.964273 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d9dabceb-8e14-44bf-86ce-6821e339f0e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:27.970534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d9dabceb-8e14-44bf-86ce-6821e339f0e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:27.971015 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d9dabceb-8e14-44bf-86ce-6821e339f0e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:27.971495 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d9dabceb-8e14-44bf-86ce-6821e339f0e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:27.972177 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d9dabceb-8e14-44bf-86ce-6821e339f0e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:27.972631 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d9dabceb-8e14-44bf-86ce-6821e339f0e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:27.973053 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d9dabceb-8e14-44bf-86ce-6821e339f0e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:28.117032 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d9dabceb-8e14-44bf-86ce-6821e339f0e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:28.127436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d9dabceb-8e14-44bf-86ce-6821e339f0e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:28.128887 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d9dabceb-8e14-44bf-86ce-6821e339f0e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:28.130052 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d9dabceb-8e14-44bf-86ce-6821e339f0e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1725 microversion: 2.20 time: 0.170386 Oct 03 12:55:28.130670 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 320/638] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:27 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:28.885039 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-353453a3-fa3d-4380-939d-74ccef701f4b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:28.885834 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-353453a3-fa3d-4380-939d-74ccef701f4b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:28.893482 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-353453a3-fa3d-4380-939d-74ccef701f4b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:28.894168 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-353453a3-fa3d-4380-939d-74ccef701f4b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:28.894687 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-353453a3-fa3d-4380-939d-74ccef701f4b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:28.895545 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-353453a3-fa3d-4380-939d-74ccef701f4b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:28.897204 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-353453a3-fa3d-4380-939d-74ccef701f4b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:28.897741 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-353453a3-fa3d-4380-939d-74ccef701f4b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:28.965146 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-353453a3-fa3d-4380-939d-74ccef701f4b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:28.973731 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-353453a3-fa3d-4380-939d-74ccef701f4b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1509 microversion: 2.1 time: 0.093354 Oct 03 12:55:28.975348 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-273cca57-f091-4db6-aa0e-6f478f5e21e2 req-721f52a5-0014-4d77-843c-88767edbcd60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47633cfc-a1d3-41c4-ab31-71cd28896c05", "name": "network-vif-deleted", "tag": "e8531efb-6d29-4faf-9d0d-838641bb6d52"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:28.975886 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 319/639] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:28 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1509 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:28.989472 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-273cca57-f091-4db6-aa0e-6f478f5e21e2 req-721f52a5-0014-4d77-843c-88767edbcd60 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:28.990328 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-273cca57-f091-4db6-aa0e-6f478f5e21e2 req-721f52a5-0014-4d77-843c-88767edbcd60 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:28.990766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-273cca57-f091-4db6-aa0e-6f478f5e21e2 req-721f52a5-0014-4d77-843c-88767edbcd60 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:29.005739 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-273cca57-f091-4db6-aa0e-6f478f5e21e2 req-721f52a5-0014-4d77-843c-88767edbcd60 service nova] Creating event network-vif-deleted:e8531efb-6d29-4faf-9d0d-838641bb6d52 for instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 on hv-cinder-84456 Oct 03 12:55:29.011520 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-273cca57-f091-4db6-aa0e-6f478f5e21e2 req-721f52a5-0014-4d77-843c-88767edbcd60 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040872 Oct 03 12:55:29.012646 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 321/640] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:55:29.157001 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1b123780-003e-4b17-813d-bf805474ee91 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:29.157697 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-1b123780-003e-4b17-813d-bf805474ee91 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:29.167046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b123780-003e-4b17-813d-bf805474ee91 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:29.171338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b123780-003e-4b17-813d-bf805474ee91 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:29.171939 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b123780-003e-4b17-813d-bf805474ee91 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:29.177156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b123780-003e-4b17-813d-bf805474ee91 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:29.178224 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b123780-003e-4b17-813d-bf805474ee91 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:29.178635 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b123780-003e-4b17-813d-bf805474ee91 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:29.358742 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-1b123780-003e-4b17-813d-bf805474ee91 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:29.368413 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-1b123780-003e-4b17-813d-bf805474ee91 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:29.370277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-1b123780-003e-4b17-813d-bf805474ee91 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:29.371594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-1b123780-003e-4b17-813d-bf805474ee91 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1725 microversion: 2.20 time: 0.218433 Oct 03 12:55:29.372699 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 320/641] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:29 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:29.997802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-991ae372-f923-4da0-b96e-eda0d868d782 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:29.998833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-991ae372-f923-4da0-b96e-eda0d868d782 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:30.006024 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-991ae372-f923-4da0-b96e-eda0d868d782 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:30.008520 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-991ae372-f923-4da0-b96e-eda0d868d782 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:30.008520 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-991ae372-f923-4da0-b96e-eda0d868d782 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:30.008520 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-991ae372-f923-4da0-b96e-eda0d868d782 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:30.009356 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-991ae372-f923-4da0-b96e-eda0d868d782 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:30.009901 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-991ae372-f923-4da0-b96e-eda0d868d782 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:30.043836 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-991ae372-f923-4da0-b96e-eda0d868d782 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:30.044332 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-991ae372-f923-4da0-b96e-eda0d868d782 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:30.044772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-991ae372-f923-4da0-b96e-eda0d868d782 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:30.045221 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-991ae372-f923-4da0-b96e-eda0d868d782 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lazy-loading 'fault' on Instance uuid 47633cfc-a1d3-41c4-ab31-71cd28896c05 {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:55:30.088761 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-991ae372-f923-4da0-b96e-eda0d868d782 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:30.099693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-991ae372-f923-4da0-b96e-eda0d868d782 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 200 len: 1230 microversion: 2.1 time: 0.105438 Oct 03 12:55:30.101153 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 322/642] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:29 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:30.398817 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-6325705b-fe7f-4f1a-91f6-e1c0e9baafec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:30.399582 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-6325705b-fe7f-4f1a-91f6-e1c0e9baafec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:30.406107 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6325705b-fe7f-4f1a-91f6-e1c0e9baafec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:30.406597 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6325705b-fe7f-4f1a-91f6-e1c0e9baafec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:30.407038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6325705b-fe7f-4f1a-91f6-e1c0e9baafec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:30.407877 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6325705b-fe7f-4f1a-91f6-e1c0e9baafec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:30.408249 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6325705b-fe7f-4f1a-91f6-e1c0e9baafec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:30.408679 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6325705b-fe7f-4f1a-91f6-e1c0e9baafec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:30.546296 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6325705b-fe7f-4f1a-91f6-e1c0e9baafec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:30.554338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6325705b-fe7f-4f1a-91f6-e1c0e9baafec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:30.555823 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6325705b-fe7f-4f1a-91f6-e1c0e9baafec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:30.558667 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-6325705b-fe7f-4f1a-91f6-e1c0e9baafec tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1725 microversion: 2.20 time: 0.162831 Oct 03 12:55:30.558667 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 321/643] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:30 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:31.124384 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d820a87d-005f-4b8a-ad6b-9ed7c4f52589 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:31.125034 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d820a87d-005f-4b8a-ad6b-9ed7c4f52589 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:31.132218 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d820a87d-005f-4b8a-ad6b-9ed7c4f52589 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:31.132702 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d820a87d-005f-4b8a-ad6b-9ed7c4f52589 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:31.133138 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d820a87d-005f-4b8a-ad6b-9ed7c4f52589 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:31.134126 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d820a87d-005f-4b8a-ad6b-9ed7c4f52589 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:31.134488 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d820a87d-005f-4b8a-ad6b-9ed7c4f52589 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:31.134996 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d820a87d-005f-4b8a-ad6b-9ed7c4f52589 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:31.148821 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-d820a87d-005f-4b8a-ad6b-9ed7c4f52589 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] HTTP exception thrown: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d820a87d-005f-4b8a-ad6b-9ed7c4f52589 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Request method failure captured: Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 HTTP/1.1 Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtrf71VhcaY_BRgY09rn0Fziy7wn5zvqq7Sl8w3d-pKgYE-iVsAEtAdWeB672MRu6Lj9k4L2KiqNiPpLYnBcyDEyKIewqW3G00eAeBGwM_xApGSar36v-W3E_-BHmWMdmz_Q7eBKs4c3wLUJgtuRau-8AFYp9P52SyX-QwaxLcU8tsE Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: 38d1778202d041b58934150c6af9685c Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-TestVolumeBootPattern-24941892 Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 12:55:31.150598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 12:55:31.152282 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38d1778202d041b58934150c6af9685c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d1778202d041b58934150c6af9685c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d1778202d041b58934150c6af9685c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38d1778202d041b58934150c6af9685c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:55:31.152282 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-TestVolumeBootPattern-24941892 Oct 03 12:55:31.152282 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: 38d1778202d041b58934150c6af9685c Oct 03 12:55:31.152282 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-TestVolumeBootPattern-24941892 Oct 03 12:55:31.152282 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-TestVolumeBootPattern-24941892-project Oct 03 12:55:31.152282 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 12:55:31.152282 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 12:55:31.152282 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: 7ffffa27986f461ebc10c23c3c9817f0 Oct 03 12:55:31.152282 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-TestVolumeBootPattern-24941892-project Oct 03 12:55:31.152282 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 12:55:31.152282 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. Oct 03 12:55:31.152282 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': '47633cfc-a1d3-41c4-ab31-71cd28896c05'} Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:55:31.153266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. Oct 03 12:55:31.154804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:55:31.156293 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d820a87d-005f-4b8a-ad6b-9ed7c4f52589 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Returning 404 to user: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:55:31.156293 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d820a87d-005f-4b8a-ad6b-9ed7c4f52589 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 404 len: 111 microversion: 2.1 time: 0.031536 Oct 03 12:55:31.156293 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 323/644] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:31 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:55:31.252149 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-111855669", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-745508035", "security_groups": [{"name": "tempest-secgroup-smoke-797083645"}], "block_device_mapping_v2": [{"uuid": "c173fd2c-66e8-437c-bb1f-6d65a1f59330", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1ccd52b4-506d-483d-a4e0-802199d3659f"}]}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:31.367735 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.network.neutron [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] validate_networks() for [('1ccd52b4-506d-483d-a4e0-802199d3659f', None, None, None, None, None)] {{(pid=127542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:55:31.581967 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-67427baf-5c16-4690-a81c-b5c949c8ced7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:31.582569 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-67427baf-5c16-4690-a81c-b5c949c8ced7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:31.588731 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67427baf-5c16-4690-a81c-b5c949c8ced7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:31.589383 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67427baf-5c16-4690-a81c-b5c949c8ced7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:31.589983 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67427baf-5c16-4690-a81c-b5c949c8ced7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:31.590923 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67427baf-5c16-4690-a81c-b5c949c8ced7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:31.591459 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67427baf-5c16-4690-a81c-b5c949c8ced7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:31.591892 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67427baf-5c16-4690-a81c-b5c949c8ced7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:31.809986 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-67427baf-5c16-4690-a81c-b5c949c8ced7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:31.818295 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-67427baf-5c16-4690-a81c-b5c949c8ced7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:31.828296 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-67427baf-5c16-4690-a81c-b5c949c8ced7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:31.828296 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-67427baf-5c16-4690-a81c-b5c949c8ced7 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1725 microversion: 2.20 time: 0.243109 Oct 03 12:55:31.828296 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 324/645] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:31 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:55:31.894900 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Flavor limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:55:31.895406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Image limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:55:31.896326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Flavor pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:55:31.896979 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Image pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:55:31.897393 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:55:31.906490 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:31.906973 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:31.907558 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:31.908339 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:31.908911 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:31.909271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:31.927478 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Getting quotas for project 38d1778202d041b58934150c6af9685c. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:55:31.931549 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Getting quotas for user 7ffffa27986f461ebc10c23c3c9817f0 and project 38d1778202d041b58934150c6af9685c. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:55:31.989272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Going to run 1 instances... {{(pid=127542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:55:31.992054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c173fd2c-66e8-437c-bb1f-6d65a1f59330',volume_size=None,volume_type=None)] {{(pid=127542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:55:32.341129 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c391d0a2-b600-4ab2-8377-31311ae0729b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.092790 Oct 03 12:55:32.341762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 322/646] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:55:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:55:32.353417 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-fe5b5330-796b-4fad-8a28-7a942a190269 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:32.354042 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-fe5b5330-796b-4fad-8a28-7a942a190269 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:32.409818 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-fe5b5330-796b-4fad-8a28-7a942a190269 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:32.416941 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-fe5b5330-796b-4fad-8a28-7a942a190269 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1093 microversion: 2.1 time: 0.067569 Oct 03 12:55:32.417506 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 325/647] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:32 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:32.847722 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d544d39b-2854-4d05-b375-f71d6cddaf38 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:32.848432 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d544d39b-2854-4d05-b375-f71d6cddaf38 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:32.855003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d544d39b-2854-4d05-b375-f71d6cddaf38 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:32.855511 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d544d39b-2854-4d05-b375-f71d6cddaf38 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:32.855956 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d544d39b-2854-4d05-b375-f71d6cddaf38 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:32.856643 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d544d39b-2854-4d05-b375-f71d6cddaf38 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:32.857092 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d544d39b-2854-4d05-b375-f71d6cddaf38 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:32.857512 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d544d39b-2854-4d05-b375-f71d6cddaf38 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:33.246981 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d544d39b-2854-4d05-b375-f71d6cddaf38 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:33.255741 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d544d39b-2854-4d05-b375-f71d6cddaf38 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:33.257406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d544d39b-2854-4d05-b375-f71d6cddaf38 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:33.263084 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d544d39b-2854-4d05-b375-f71d6cddaf38 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1725 microversion: 2.20 time: 0.415160 Oct 03 12:55:33.263084 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 323/648] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:32 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1725 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:33.439352 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a10ad375-a0f0-499a-9304-4b923ef448b5 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:33.439999 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a10ad375-a0f0-499a-9304-4b923ef448b5 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:33.507220 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-a10ad375-a0f0-499a-9304-4b923ef448b5 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:33.527952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a10ad375-a0f0-499a-9304-4b923ef448b5 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1093 microversion: 2.1 time: 0.092287 Oct 03 12:55:33.528585 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 326/649] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:33 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1093 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:34.283983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b4f444af-9f89-49d1-933b-411203164bad tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:34.284595 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b4f444af-9f89-49d1-933b-411203164bad tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:34.291580 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4f444af-9f89-49d1-933b-411203164bad tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:34.292065 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4f444af-9f89-49d1-933b-411203164bad tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:34.292503 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4f444af-9f89-49d1-933b-411203164bad tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:34.293192 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4f444af-9f89-49d1-933b-411203164bad tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:34.293648 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4f444af-9f89-49d1-933b-411203164bad tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:34.294073 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4f444af-9f89-49d1-933b-411203164bad tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:34.442470 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-b4f444af-9f89-49d1-933b-411203164bad tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:34.451223 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-b4f444af-9f89-49d1-933b-411203164bad tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:34.452715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-b4f444af-9f89-49d1-933b-411203164bad tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:34.453869 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-b4f444af-9f89-49d1-933b-411203164bad tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1725 microversion: 2.20 time: 0.173836 Oct 03 12:55:34.454448 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 324/650] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:34 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:34.553947 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8e1bda8e-a9cf-4232-8845-9f17af9815a9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:34.553947 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8e1bda8e-a9cf-4232-8845-9f17af9815a9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:34.561047 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e1bda8e-a9cf-4232-8845-9f17af9815a9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:34.561816 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e1bda8e-a9cf-4232-8845-9f17af9815a9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:34.563214 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e1bda8e-a9cf-4232-8845-9f17af9815a9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:34.564127 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e1bda8e-a9cf-4232-8845-9f17af9815a9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:34.565587 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e1bda8e-a9cf-4232-8845-9f17af9815a9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:34.567297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e1bda8e-a9cf-4232-8845-9f17af9815a9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:34.653379 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8e1bda8e-a9cf-4232-8845-9f17af9815a9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:34.662387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-8e1bda8e-a9cf-4232-8845-9f17af9815a9 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1191 microversion: 2.1 time: 0.115806 Oct 03 12:55:34.675395 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 327/651] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:34 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1191 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:35.269665 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-274eac75-a0e3-489c-a5c2-e2da8be2b763 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:35.272464 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-274eac75-a0e3-489c-a5c2-e2da8be2b763 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:35.280273 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-274eac75-a0e3-489c-a5c2-e2da8be2b763 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:35.283819 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-274eac75-a0e3-489c-a5c2-e2da8be2b763 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:35.283819 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-274eac75-a0e3-489c-a5c2-e2da8be2b763 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:35.283819 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-274eac75-a0e3-489c-a5c2-e2da8be2b763 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:35.283819 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-274eac75-a0e3-489c-a5c2-e2da8be2b763 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:35.284572 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-274eac75-a0e3-489c-a5c2-e2da8be2b763 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:35.323049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-274eac75-a0e3-489c-a5c2-e2da8be2b763 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057459 Oct 03 12:55:35.323965 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 325/652] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 12:55:35 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:55:35.335304 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e937e697-d312-4059-8d6f-46f3a968b499 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:35.336223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-e937e697-d312-4059-8d6f-46f3a968b499 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:35.342529 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e937e697-d312-4059-8d6f-46f3a968b499 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:35.343522 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e937e697-d312-4059-8d6f-46f3a968b499 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:35.343915 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e937e697-d312-4059-8d6f-46f3a968b499 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:35.344696 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e937e697-d312-4059-8d6f-46f3a968b499 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:35.345411 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e937e697-d312-4059-8d6f-46f3a968b499 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:35.345908 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e937e697-d312-4059-8d6f-46f3a968b499 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:35.378218 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e937e697-d312-4059-8d6f-46f3a968b499 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments/c58c4303-ee69-495d-923a-e7f2b95ab921" status: 200 len: 194 microversion: 2.1 time: 0.047233 Oct 03 12:55:35.378939 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 328/653] 10.222.0.33 () {58 vars in 1413 bytes} [Mon Oct 3 12:55:35 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments/c58c4303-ee69-495d-923a-e7f2b95ab921 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:55:35.491976 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-36d6b3e0-7181-49f1-80ae-aa750299f3fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:35.496004 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-36d6b3e0-7181-49f1-80ae-aa750299f3fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:35.514775 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36d6b3e0-7181-49f1-80ae-aa750299f3fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:35.514775 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36d6b3e0-7181-49f1-80ae-aa750299f3fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:35.514775 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36d6b3e0-7181-49f1-80ae-aa750299f3fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:35.514775 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36d6b3e0-7181-49f1-80ae-aa750299f3fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:35.516101 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36d6b3e0-7181-49f1-80ae-aa750299f3fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:35.516748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36d6b3e0-7181-49f1-80ae-aa750299f3fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:35.667196 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-36d6b3e0-7181-49f1-80ae-aa750299f3fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:35.671139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:35.676185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-36d6b3e0-7181-49f1-80ae-aa750299f3fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:35.679035 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-36d6b3e0-7181-49f1-80ae-aa750299f3fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:35.680297 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-36d6b3e0-7181-49f1-80ae-aa750299f3fe tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1746 microversion: 2.20 time: 0.202724 Oct 03 12:55:35.680867 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 326/654] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:35 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1746 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:35.688965 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-500b085b-dacf-4301-ada2-ce0995e9f82e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:35.689670 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-500b085b-dacf-4301-ada2-ce0995e9f82e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:35.697200 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-500b085b-dacf-4301-ada2-ce0995e9f82e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:35.697773 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-500b085b-dacf-4301-ada2-ce0995e9f82e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:35.698401 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-500b085b-dacf-4301-ada2-ce0995e9f82e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:35.699109 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-500b085b-dacf-4301-ada2-ce0995e9f82e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:35.699601 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-500b085b-dacf-4301-ada2-ce0995e9f82e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:35.700036 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-500b085b-dacf-4301-ada2-ce0995e9f82e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:35.774331 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-500b085b-dacf-4301-ada2-ce0995e9f82e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:35.783832 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-500b085b-dacf-4301-ada2-ce0995e9f82e tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1209 microversion: 2.1 time: 0.098540 Oct 03 12:55:35.784841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 329/655] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:35 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:36.706344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c4e00f84-b289-4fa1-929f-60d35dd1d774 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:36.707162 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c4e00f84-b289-4fa1-929f-60d35dd1d774 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:36.715163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4e00f84-b289-4fa1-929f-60d35dd1d774 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:36.715678 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4e00f84-b289-4fa1-929f-60d35dd1d774 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:36.716320 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4e00f84-b289-4fa1-929f-60d35dd1d774 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:36.717023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4e00f84-b289-4fa1-929f-60d35dd1d774 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:36.717503 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4e00f84-b289-4fa1-929f-60d35dd1d774 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:36.717935 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4e00f84-b289-4fa1-929f-60d35dd1d774 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:36.809250 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-25b87b7d-f671-4602-82c6-2ec38baa3aec tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:36.809859 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-25b87b7d-f671-4602-82c6-2ec38baa3aec tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:36.816896 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-25b87b7d-f671-4602-82c6-2ec38baa3aec tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:36.821358 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-25b87b7d-f671-4602-82c6-2ec38baa3aec tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:36.821358 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-25b87b7d-f671-4602-82c6-2ec38baa3aec tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:36.821358 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-25b87b7d-f671-4602-82c6-2ec38baa3aec tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:36.821358 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-25b87b7d-f671-4602-82c6-2ec38baa3aec tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:36.821703 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-25b87b7d-f671-4602-82c6-2ec38baa3aec tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:36.845995 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:36.867509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c4e00f84-b289-4fa1-929f-60d35dd1d774 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:36.876466 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c4e00f84-b289-4fa1-929f-60d35dd1d774 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:36.877919 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c4e00f84-b289-4fa1-929f-60d35dd1d774 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:36.879288 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c4e00f84-b289-4fa1-929f-60d35dd1d774 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1746 microversion: 2.20 time: 0.177007 Oct 03 12:55:36.889014 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 327/656] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:36 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1746 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:36.981605 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-25b87b7d-f671-4602-82c6-2ec38baa3aec tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:36.991472 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-25b87b7d-f671-4602-82c6-2ec38baa3aec tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1276 microversion: 2.1 time: 0.185506 Oct 03 12:55:36.993680 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 330/657] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:36 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:37.066211 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d2cb5cbc-7659-43b2-ac7c-e5f5dcd0a4da tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2120452-f211-4fdd-a2be-5d2a7ab9bc66"}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:37.069409 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d2cb5cbc-7659-43b2-ac7c-e5f5dcd0a4da tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:37.075810 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2cb5cbc-7659-43b2-ac7c-e5f5dcd0a4da tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:37.076300 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2cb5cbc-7659-43b2-ac7c-e5f5dcd0a4da tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:37.076734 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2cb5cbc-7659-43b2-ac7c-e5f5dcd0a4da tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:37.077532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2cb5cbc-7659-43b2-ac7c-e5f5dcd0a4da tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:37.078008 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2cb5cbc-7659-43b2-ac7c-e5f5dcd0a4da tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:37.078458 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d2cb5cbc-7659-43b2-ac7c-e5f5dcd0a4da tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:37.376041 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-500c8fa8-7683-482e-88da-2daaf3618af4 req-21f1b235-2b1f-4541-9ef7-27f61e082cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0ce55bf-3f09-490a-baf4-0822672b5805", "tag": "e0d4db50-7910-4292-8ab0-c965757c89d7"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:37.386600 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-500c8fa8-7683-482e-88da-2daaf3618af4 req-21f1b235-2b1f-4541-9ef7-27f61e082cf3 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:37.387431 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-500c8fa8-7683-482e-88da-2daaf3618af4 req-21f1b235-2b1f-4541-9ef7-27f61e082cf3 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:37.388105 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-500c8fa8-7683-482e-88da-2daaf3618af4 req-21f1b235-2b1f-4541-9ef7-27f61e082cf3 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:37.401151 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-500c8fa8-7683-482e-88da-2daaf3618af4 req-21f1b235-2b1f-4541-9ef7-27f61e082cf3 service nova] Creating event network-changed:e0d4db50-7910-4292-8ab0-c965757c89d7 for instance b0ce55bf-3f09-490a-baf4-0822672b5805 on hv-cinder-84456 Oct 03 12:55:37.406223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-500c8fa8-7683-482e-88da-2daaf3618af4 req-21f1b235-2b1f-4541-9ef7-27f61e082cf3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034377 Oct 03 12:55:37.406817 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 331/658] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:55:37.909244 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0711bd2c-e0c9-44c2-894c-38b8ff76622b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:37.910407 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-0711bd2c-e0c9-44c2-894c-38b8ff76622b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:37.918930 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0711bd2c-e0c9-44c2-894c-38b8ff76622b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:37.919555 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0711bd2c-e0c9-44c2-894c-38b8ff76622b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:37.920564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d2cb5cbc-7659-43b2-ac7c-e5f5dcd0a4da tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "POST /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.856521 Oct 03 12:55:37.921197 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 328/659] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 12:55:37 2022] POST /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments => generated 194 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:55:37.921337 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0711bd2c-e0c9-44c2-894c-38b8ff76622b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:37.922303 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0711bd2c-e0c9-44c2-894c-38b8ff76622b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:37.923055 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0711bd2c-e0c9-44c2-894c-38b8ff76622b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:37.923679 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0711bd2c-e0c9-44c2-894c-38b8ff76622b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:38.017112 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-2e96748f-f611-4680-b0cd-d2d19fa29995 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:38.017924 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-2e96748f-f611-4680-b0cd-d2d19fa29995 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:38.027078 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2e96748f-f611-4680-b0cd-d2d19fa29995 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:38.040844 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2e96748f-f611-4680-b0cd-d2d19fa29995 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:38.041311 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2e96748f-f611-4680-b0cd-d2d19fa29995 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:38.042147 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2e96748f-f611-4680-b0cd-d2d19fa29995 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:38.042622 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2e96748f-f611-4680-b0cd-d2d19fa29995 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:38.043064 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2e96748f-f611-4680-b0cd-d2d19fa29995 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:38.160653 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0711bd2c-e0c9-44c2-894c-38b8ff76622b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:38.169786 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0711bd2c-e0c9-44c2-894c-38b8ff76622b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:38.170945 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0711bd2c-e0c9-44c2-894c-38b8ff76622b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:38.172282 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0711bd2c-e0c9-44c2-894c-38b8ff76622b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1741 microversion: 2.20 time: 0.268256 Oct 03 12:55:38.172835 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 332/660] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:37 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1741 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:55:38.238503 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-2e96748f-f611-4680-b0cd-d2d19fa29995 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:38.246409 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-2e96748f-f611-4680-b0cd-d2d19fa29995 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1264 microversion: 2.1 time: 0.233753 Oct 03 12:55:38.246996 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 329/661] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:38 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1264 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:55:39.206123 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-846e9668-b001-41e1-8588-8e1986c9fea9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:39.207930 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-846e9668-b001-41e1-8588-8e1986c9fea9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:39.222406 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-846e9668-b001-41e1-8588-8e1986c9fea9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:39.227488 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-846e9668-b001-41e1-8588-8e1986c9fea9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:39.227488 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-846e9668-b001-41e1-8588-8e1986c9fea9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:39.233007 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-846e9668-b001-41e1-8588-8e1986c9fea9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:39.233996 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-846e9668-b001-41e1-8588-8e1986c9fea9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:39.234609 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-846e9668-b001-41e1-8588-8e1986c9fea9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:39.272513 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4c82e4a0-4baf-4731-8113-1a425f1ae79b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:39.276807 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-4c82e4a0-4baf-4731-8113-1a425f1ae79b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:39.280947 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4c82e4a0-4baf-4731-8113-1a425f1ae79b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:39.300757 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4c82e4a0-4baf-4731-8113-1a425f1ae79b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:39.302627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4c82e4a0-4baf-4731-8113-1a425f1ae79b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:39.303419 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4c82e4a0-4baf-4731-8113-1a425f1ae79b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:39.303899 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4c82e4a0-4baf-4731-8113-1a425f1ae79b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:39.304339 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4c82e4a0-4baf-4731-8113-1a425f1ae79b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:39.616841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-846e9668-b001-41e1-8588-8e1986c9fea9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:39.644548 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-846e9668-b001-41e1-8588-8e1986c9fea9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:39.647016 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-846e9668-b001-41e1-8588-8e1986c9fea9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:39.649568 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-846e9668-b001-41e1-8588-8e1986c9fea9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1741 microversion: 2.20 time: 0.448516 Oct 03 12:55:39.651154 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 333/662] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:39 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1741 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:39.699010 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4c82e4a0-4baf-4731-8113-1a425f1ae79b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:39.725649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-4c82e4a0-4baf-4731-8113-1a425f1ae79b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1264 microversion: 2.1 time: 0.459404 Oct 03 12:55:39.727497 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 330/663] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:39 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1264 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:55:39.835094 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-a4f70f18-3682-4b84-82ba-609d6a8d8386 req-a4af36dd-15eb-4c96-b9fd-d8f2c910dbf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b37dd24-5a6e-4898-8247-8e00786088ea", "name": "network-vif-plugged", "status": "completed", "tag": "778fd61a-2cb6-43b5-ad14-c9a69f32bf7c"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:39.847501 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-a4f70f18-3682-4b84-82ba-609d6a8d8386 req-a4af36dd-15eb-4c96-b9fd-d8f2c910dbf4 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:39.847982 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-a4f70f18-3682-4b84-82ba-609d6a8d8386 req-a4af36dd-15eb-4c96-b9fd-d8f2c910dbf4 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:39.848409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-a4f70f18-3682-4b84-82ba-609d6a8d8386 req-a4af36dd-15eb-4c96-b9fd-d8f2c910dbf4 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:39.864552 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-a4f70f18-3682-4b84-82ba-609d6a8d8386 req-a4af36dd-15eb-4c96-b9fd-d8f2c910dbf4 service nova] Creating event network-vif-plugged:778fd61a-2cb6-43b5-ad14-c9a69f32bf7c for instance 6b37dd24-5a6e-4898-8247-8e00786088ea on hv-cinder-84456 Oct 03 12:55:39.873128 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-a4f70f18-3682-4b84-82ba-609d6a8d8386 req-a4af36dd-15eb-4c96-b9fd-d8f2c910dbf4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218894 Oct 03 12:55:39.874120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 334/664] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:55:40.681708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3b7796a9-8e96-4e5d-a992-8dee335bc897 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:40.682436 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3b7796a9-8e96-4e5d-a992-8dee335bc897 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:40.689911 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3b7796a9-8e96-4e5d-a992-8dee335bc897 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:40.695338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3b7796a9-8e96-4e5d-a992-8dee335bc897 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:40.697240 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3b7796a9-8e96-4e5d-a992-8dee335bc897 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:40.698245 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3b7796a9-8e96-4e5d-a992-8dee335bc897 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:40.698801 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3b7796a9-8e96-4e5d-a992-8dee335bc897 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:40.699306 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3b7796a9-8e96-4e5d-a992-8dee335bc897 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:40.751198 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-f247ecf6-5be5-4d8a-a904-9573e1ff3403 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:40.754522 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-f247ecf6-5be5-4d8a-a904-9573e1ff3403 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:40.766294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f247ecf6-5be5-4d8a-a904-9573e1ff3403 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:40.767047 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f247ecf6-5be5-4d8a-a904-9573e1ff3403 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:40.767685 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f247ecf6-5be5-4d8a-a904-9573e1ff3403 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:40.768623 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f247ecf6-5be5-4d8a-a904-9573e1ff3403 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:40.769235 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f247ecf6-5be5-4d8a-a904-9573e1ff3403 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:40.770034 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f247ecf6-5be5-4d8a-a904-9573e1ff3403 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:40.961412 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3b7796a9-8e96-4e5d-a992-8dee335bc897 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:40.980021 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3b7796a9-8e96-4e5d-a992-8dee335bc897 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:40.981861 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3b7796a9-8e96-4e5d-a992-8dee335bc897 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:40.983421 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3b7796a9-8e96-4e5d-a992-8dee335bc897 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1741 microversion: 2.20 time: 0.306657 Oct 03 12:55:40.984187 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 331/665] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:40 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1741 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:40.999527 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-f247ecf6-5be5-4d8a-a904-9573e1ff3403 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:41.009254 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-f247ecf6-5be5-4d8a-a904-9573e1ff3403 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1264 microversion: 2.1 time: 0.262658 Oct 03 12:55:41.009910 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 335/666] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:40 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1264 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:55:42.019215 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-920b9e01-4e20-4083-bd26-f68d93ac31e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:42.020329 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-920b9e01-4e20-4083-bd26-f68d93ac31e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:42.024823 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:42.025271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=6 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:42.037869 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-709b1510-3a02-4521-a640-ecef4d7d367b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:42.039112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-709b1510-3a02-4521-a640-ecef4d7d367b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:42.056832 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-920b9e01-4e20-4083-bd26-f68d93ac31e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:42.056832 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-920b9e01-4e20-4083-bd26-f68d93ac31e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:42.056832 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-920b9e01-4e20-4083-bd26-f68d93ac31e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:42.056832 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-920b9e01-4e20-4083-bd26-f68d93ac31e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:42.057496 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-920b9e01-4e20-4083-bd26-f68d93ac31e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:42.057496 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-920b9e01-4e20-4083-bd26-f68d93ac31e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:42.057641 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-709b1510-3a02-4521-a640-ecef4d7d367b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:42.057641 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-709b1510-3a02-4521-a640-ecef4d7d367b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:42.057641 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-709b1510-3a02-4521-a640-ecef4d7d367b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:42.057641 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-709b1510-3a02-4521-a640-ecef4d7d367b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:42.057931 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-709b1510-3a02-4521-a640-ecef4d7d367b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:42.057931 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-709b1510-3a02-4521-a640-ecef4d7d367b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:42.283007 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-709b1510-3a02-4521-a640-ecef4d7d367b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:42.287260 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-920b9e01-4e20-4083-bd26-f68d93ac31e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:42.291858 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-709b1510-3a02-4521-a640-ecef4d7d367b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1264 microversion: 2.1 time: 0.258539 Oct 03 12:55:42.292529 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 336/667] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:42 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:55:42.295595 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-920b9e01-4e20-4083-bd26-f68d93ac31e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:42.297040 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-920b9e01-4e20-4083-bd26-f68d93ac31e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:42.298209 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-920b9e01-4e20-4083-bd26-f68d93ac31e0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1741 microversion: 2.20 time: 0.289175 Oct 03 12:55:42.298756 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 332/668] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:42 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1741 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:43.319853 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bc496dea-bd28-48e8-8bc3-3b95861344aa tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:43.321227 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-bc496dea-bd28-48e8-8bc3-3b95861344aa tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:43.324847 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a63fd1e2-2446-41c4-bca1-c06bd86e40ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:43.326037 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a63fd1e2-2446-41c4-bca1-c06bd86e40ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:43.328241 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bc496dea-bd28-48e8-8bc3-3b95861344aa tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:43.328941 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bc496dea-bd28-48e8-8bc3-3b95861344aa tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:43.329632 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bc496dea-bd28-48e8-8bc3-3b95861344aa tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:43.330516 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bc496dea-bd28-48e8-8bc3-3b95861344aa tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:43.331141 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bc496dea-bd28-48e8-8bc3-3b95861344aa tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:43.331758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bc496dea-bd28-48e8-8bc3-3b95861344aa tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:43.333005 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a63fd1e2-2446-41c4-bca1-c06bd86e40ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:43.333757 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a63fd1e2-2446-41c4-bca1-c06bd86e40ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:43.334500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a63fd1e2-2446-41c4-bca1-c06bd86e40ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:43.336035 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a63fd1e2-2446-41c4-bca1-c06bd86e40ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:43.336670 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a63fd1e2-2446-41c4-bca1-c06bd86e40ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:43.337269 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a63fd1e2-2446-41c4-bca1-c06bd86e40ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:43.511168 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=4 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:43.545859 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a63fd1e2-2446-41c4-bca1-c06bd86e40ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:43.555181 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a63fd1e2-2446-41c4-bca1-c06bd86e40ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:43.556822 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a63fd1e2-2446-41c4-bca1-c06bd86e40ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:43.558849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a63fd1e2-2446-41c4-bca1-c06bd86e40ff tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1741 microversion: 2.20 time: 0.239076 Oct 03 12:55:43.559437 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 333/669] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:43 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1741 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:43.561399 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-bc496dea-bd28-48e8-8bc3-3b95861344aa tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:43.573152 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-bc496dea-bd28-48e8-8bc3-3b95861344aa tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1264 microversion: 2.1 time: 0.260518 Oct 03 12:55:43.573888 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 337/670] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:43 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1264 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:44.230368 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-526658916", "imageRef": "9d585789-e496-433d-b311-70ec7ceffd99", "flavorRef": "452"}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:44.287960 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.network.neutron [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] validate_networks() for None {{(pid=127542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:55:44.587238 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3c4dcf7f-b307-49bf-9e5b-f366c621fda8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:44.592717 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-3c4dcf7f-b307-49bf-9e5b-f366c621fda8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:44.600914 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3c4dcf7f-b307-49bf-9e5b-f366c621fda8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:44.604165 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3c4dcf7f-b307-49bf-9e5b-f366c621fda8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:44.604165 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3c4dcf7f-b307-49bf-9e5b-f366c621fda8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:44.604165 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3c4dcf7f-b307-49bf-9e5b-f366c621fda8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:44.604165 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3c4dcf7f-b307-49bf-9e5b-f366c621fda8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:44.604565 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3c4dcf7f-b307-49bf-9e5b-f366c621fda8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:44.612261 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Flavor limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:55:44.613289 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Image limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:55:44.613995 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Flavor pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:55:44.615478 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Image pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:55:44.616469 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:55:44.638734 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:44.639792 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:44.640337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:44.641169 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:44.641720 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:44.642219 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:44.664306 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Getting quotas for project ead596751f234d79b38d661b0d5c6343. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:55:44.669594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Getting quotas for user d3b8ec0638764aba88e1920ecca7ddbc and project ead596751f234d79b38d661b0d5c6343. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:55:44.687289 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Going to run 1 instances... {{(pid=127542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:55:44.689741 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d585789-e496-433d-b311-70ec7ceffd99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:55:44.805008 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-656d7692-d36e-4826-b078-01273adabfbe tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578342 Oct 03 12:55:44.807445 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3c4dcf7f-b307-49bf-9e5b-f366c621fda8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:44.818072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3c4dcf7f-b307-49bf-9e5b-f366c621fda8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:44.819603 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 334/671] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:55:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:55:44.830138 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3c4dcf7f-b307-49bf-9e5b-f366c621fda8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:44.831534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-3c4dcf7f-b307-49bf-9e5b-f366c621fda8 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1741 microversion: 2.20 time: 0.250676 Oct 03 12:55:44.843347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 338/672] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:44 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1741 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:44.843550 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-9b5f68eb-1c97-4603-b21c-1cc442eff8fb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:44.843550 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-9b5f68eb-1c97-4603-b21c-1cc442eff8fb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:44.843772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0325bf42-8189-4cb4-9f2a-2169784819f4 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:44.843772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-0325bf42-8189-4cb4-9f2a-2169784819f4 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:44.860860 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9b5f68eb-1c97-4603-b21c-1cc442eff8fb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:44.861518 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9b5f68eb-1c97-4603-b21c-1cc442eff8fb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:44.862232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9b5f68eb-1c97-4603-b21c-1cc442eff8fb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:44.863480 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9b5f68eb-1c97-4603-b21c-1cc442eff8fb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:44.864052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9b5f68eb-1c97-4603-b21c-1cc442eff8fb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:44.864823 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9b5f68eb-1c97-4603-b21c-1cc442eff8fb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:44.929532 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0325bf42-8189-4cb4-9f2a-2169784819f4 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b8ec0638764aba88e1920ecca7ddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead596751f234d79b38d661b0d5c6343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:44.941072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0325bf42-8189-4cb4-9f2a-2169784819f4 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 200 len: 1214 microversion: 2.1 time: 0.107496 Oct 03 12:55:44.941857 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 339/673] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:44 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:45.046338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-9b5f68eb-1c97-4603-b21c-1cc442eff8fb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:45.055437 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-9b5f68eb-1c97-4603-b21c-1cc442eff8fb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1264 microversion: 2.1 time: 0.234699 Oct 03 12:55:45.056058 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 335/674] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:44 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:45.862597 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-19c72643-8a60-4912-802a-e2bac5e84586 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:45.863264 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-19c72643-8a60-4912-802a-e2bac5e84586 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:45.871515 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-19c72643-8a60-4912-802a-e2bac5e84586 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:45.872005 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-19c72643-8a60-4912-802a-e2bac5e84586 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:45.872482 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-19c72643-8a60-4912-802a-e2bac5e84586 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:45.873192 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-19c72643-8a60-4912-802a-e2bac5e84586 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:45.873726 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-19c72643-8a60-4912-802a-e2bac5e84586 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:45.874207 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-19c72643-8a60-4912-802a-e2bac5e84586 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:45.965076 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-bc231e11-6dea-41f7-a558-0eadaedbed9e tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:45.965833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-bc231e11-6dea-41f7-a558-0eadaedbed9e tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:46.045085 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-bc231e11-6dea-41f7-a558-0eadaedbed9e tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b8ec0638764aba88e1920ecca7ddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead596751f234d79b38d661b0d5c6343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:46.049279 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-19c72643-8a60-4912-802a-e2bac5e84586 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:46.052236 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-bc231e11-6dea-41f7-a558-0eadaedbed9e tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 200 len: 1214 microversion: 2.1 time: 0.091006 Oct 03 12:55:46.052818 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 336/675] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:45 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:55:46.062303 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-19c72643-8a60-4912-802a-e2bac5e84586 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:46.062303 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-19c72643-8a60-4912-802a-e2bac5e84586 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:46.062303 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-19c72643-8a60-4912-802a-e2bac5e84586 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1741 microversion: 2.20 time: 0.203209 Oct 03 12:55:46.067575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 340/676] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:45 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:46.083337 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9c6f125a-e634-4c28-8d5b-06e53e498113 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:46.085175 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-9c6f125a-e634-4c28-8d5b-06e53e498113 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:46.091472 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9c6f125a-e634-4c28-8d5b-06e53e498113 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:46.091979 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9c6f125a-e634-4c28-8d5b-06e53e498113 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:46.092436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9c6f125a-e634-4c28-8d5b-06e53e498113 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:46.093161 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9c6f125a-e634-4c28-8d5b-06e53e498113 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:46.093625 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9c6f125a-e634-4c28-8d5b-06e53e498113 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:46.094058 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9c6f125a-e634-4c28-8d5b-06e53e498113 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:46.232384 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9c6f125a-e634-4c28-8d5b-06e53e498113 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:46.241503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-9c6f125a-e634-4c28-8d5b-06e53e498113 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1264 microversion: 2.1 time: 0.162450 Oct 03 12:55:46.242099 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 341/677] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:46 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:46.836206 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-232dddb2-6eff-4383-b333-5ddf4be92c7a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:46.838808 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-232dddb2-6eff-4383-b333-5ddf4be92c7a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:46.846250 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-232dddb2-6eff-4383-b333-5ddf4be92c7a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:46.847038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-232dddb2-6eff-4383-b333-5ddf4be92c7a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:46.847693 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-232dddb2-6eff-4383-b333-5ddf4be92c7a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:46.849344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-232dddb2-6eff-4383-b333-5ddf4be92c7a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:46.849992 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-232dddb2-6eff-4383-b333-5ddf4be92c7a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:46.850637 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-232dddb2-6eff-4383-b333-5ddf4be92c7a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:46.884539 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-232dddb2-6eff-4383-b333-5ddf4be92c7a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052795 Oct 03 12:55:46.885127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 337/678] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 12:55:46 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:55:47.002110 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bba6434f-89f8-4ca2-beb1-39f3bd0ad88d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:47.002733 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-bba6434f-89f8-4ca2-beb1-39f3bd0ad88d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:47.011582 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:47.013870 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bba6434f-89f8-4ca2-beb1-39f3bd0ad88d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:47.014618 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bba6434f-89f8-4ca2-beb1-39f3bd0ad88d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:47.015133 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bba6434f-89f8-4ca2-beb1-39f3bd0ad88d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:47.015946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bba6434f-89f8-4ca2-beb1-39f3bd0ad88d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:47.016633 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bba6434f-89f8-4ca2-beb1-39f3bd0ad88d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:47.017410 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bba6434f-89f8-4ca2-beb1-39f3bd0ad88d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:47.071186 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-bba6434f-89f8-4ca2-beb1-39f3bd0ad88d tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments/c58c4303-ee69-495d-923a-e7f2b95ab921" status: 200 len: 194 microversion: 2.1 time: 0.074363 Oct 03 12:55:47.076146 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 342/679] 10.222.0.33 () {58 vars in 1413 bytes} [Mon Oct 3 12:55:46 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments/c58c4303-ee69-495d-923a-e7f2b95ab921 => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:55:47.076932 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f3610a9b-3fef-4f81-83be-131b62a2f0e8 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:47.077565 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f3610a9b-3fef-4f81-83be-131b62a2f0e8 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:47.089441 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3610a9b-3fef-4f81-83be-131b62a2f0e8 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:47.090280 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3610a9b-3fef-4f81-83be-131b62a2f0e8 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:47.091109 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3610a9b-3fef-4f81-83be-131b62a2f0e8 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:47.092056 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3610a9b-3fef-4f81-83be-131b62a2f0e8 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:47.092699 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3610a9b-3fef-4f81-83be-131b62a2f0e8 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:47.093302 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f3610a9b-3fef-4f81-83be-131b62a2f0e8 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:47.095793 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8178580c-7ebf-4b30-85ff-d72574a48d73 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:47.096448 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8178580c-7ebf-4b30-85ff-d72574a48d73 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:47.103652 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8178580c-7ebf-4b30-85ff-d72574a48d73 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:47.104243 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8178580c-7ebf-4b30-85ff-d72574a48d73 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:47.105102 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8178580c-7ebf-4b30-85ff-d72574a48d73 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:47.105934 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8178580c-7ebf-4b30-85ff-d72574a48d73 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:47.106467 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8178580c-7ebf-4b30-85ff-d72574a48d73 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:47.106968 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8178580c-7ebf-4b30-85ff-d72574a48d73 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:47.193700 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-f3610a9b-3fef-4f81-83be-131b62a2f0e8 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b8ec0638764aba88e1920ecca7ddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead596751f234d79b38d661b0d5c6343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:47.211065 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f3610a9b-3fef-4f81-83be-131b62a2f0e8 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 200 len: 1210 microversion: 2.1 time: 0.138123 Oct 03 12:55:47.212093 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 338/680] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:47 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 1210 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:55:47.216766 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-64fd53c4-324b-4540-be58-81e927b5e6bd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:47.217462 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-64fd53c4-324b-4540-be58-81e927b5e6bd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:47.225757 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-64fd53c4-324b-4540-be58-81e927b5e6bd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:47.226529 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-64fd53c4-324b-4540-be58-81e927b5e6bd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:47.227277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-64fd53c4-324b-4540-be58-81e927b5e6bd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:47.228335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-64fd53c4-324b-4540-be58-81e927b5e6bd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:47.228987 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-64fd53c4-324b-4540-be58-81e927b5e6bd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:47.229989 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-64fd53c4-324b-4540-be58-81e927b5e6bd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:47.297071 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-8178580c-7ebf-4b30-85ff-d72574a48d73 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lazy-loading 'services' on Instance uuid 03a5c967-4163-4841-ae8c-77d508c0ff59 {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:55:47.493691 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-64fd53c4-324b-4540-be58-81e927b5e6bd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:47.505997 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-64fd53c4-324b-4540-be58-81e927b5e6bd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:47.508025 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-64fd53c4-324b-4540-be58-81e927b5e6bd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:47.509571 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-64fd53c4-324b-4540-be58-81e927b5e6bd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1741 microversion: 2.20 time: 0.296704 Oct 03 12:55:47.510784 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 339/681] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:47 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1741 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:47.532446 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4690c54b-0c0d-49d7-a5f0-59161a27e09d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:47.544229 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-4690c54b-0c0d-49d7-a5f0-59161a27e09d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:47.545916 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4690c54b-0c0d-49d7-a5f0-59161a27e09d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:47.546860 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4690c54b-0c0d-49d7-a5f0-59161a27e09d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:47.547533 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4690c54b-0c0d-49d7-a5f0-59161a27e09d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:47.548544 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4690c54b-0c0d-49d7-a5f0-59161a27e09d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:47.549201 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4690c54b-0c0d-49d7-a5f0-59161a27e09d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:47.549835 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4690c54b-0c0d-49d7-a5f0-59161a27e09d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:47.615894 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-8178580c-7ebf-4b30-85ff-d72574a48d73 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments/c58c4303-ee69-495d-923a-e7f2b95ab921" status: 202 len: 0 microversion: 2.1 time: 0.531311 Oct 03 12:55:47.617265 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 343/682] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 12:55:47 2022] DELETE /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments/c58c4303-ee69-495d-923a-e7f2b95ab921 => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:55:47.670405 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-33b13b9a-5191-4f4a-8ce8-794b4a152bc9 req-e9def922-99a3-4550-914b-19c647ff7926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0ce55bf-3f09-490a-baf4-0822672b5805", "name": "network-vif-plugged", "status": "completed", "tag": "e0d4db50-7910-4292-8ab0-c965757c89d7"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:47.681388 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-33b13b9a-5191-4f4a-8ce8-794b4a152bc9 req-e9def922-99a3-4550-914b-19c647ff7926 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:47.682124 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-33b13b9a-5191-4f4a-8ce8-794b4a152bc9 req-e9def922-99a3-4550-914b-19c647ff7926 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:47.682725 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-33b13b9a-5191-4f4a-8ce8-794b4a152bc9 req-e9def922-99a3-4550-914b-19c647ff7926 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:47.706879 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-33b13b9a-5191-4f4a-8ce8-794b4a152bc9 req-e9def922-99a3-4550-914b-19c647ff7926 service nova] Creating event network-vif-plugged:e0d4db50-7910-4292-8ab0-c965757c89d7 for instance b0ce55bf-3f09-490a-baf4-0822672b5805 on hv-cinder-84456 Oct 03 12:55:47.714741 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-33b13b9a-5191-4f4a-8ce8-794b4a152bc9 req-e9def922-99a3-4550-914b-19c647ff7926 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048595 Oct 03 12:55:47.720118 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 344/683] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:55:47.734528 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4690c54b-0c0d-49d7-a5f0-59161a27e09d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:47.751111 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-4690c54b-0c0d-49d7-a5f0-59161a27e09d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1264 microversion: 2.1 time: 0.226564 Oct 03 12:55:47.754766 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 340/684] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:47 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1264 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:48.248416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c116c954-9de5-40b9-86c3-d75232159098 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:48.249428 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-c116c954-9de5-40b9-86c3-d75232159098 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:48.256882 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c116c954-9de5-40b9-86c3-d75232159098 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:48.257855 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c116c954-9de5-40b9-86c3-d75232159098 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:48.258522 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c116c954-9de5-40b9-86c3-d75232159098 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:48.259542 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c116c954-9de5-40b9-86c3-d75232159098 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:48.260418 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c116c954-9de5-40b9-86c3-d75232159098 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:48.260710 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c116c954-9de5-40b9-86c3-d75232159098 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:48.352671 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c116c954-9de5-40b9-86c3-d75232159098 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b8ec0638764aba88e1920ecca7ddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead596751f234d79b38d661b0d5c6343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:48.385736 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c116c954-9de5-40b9-86c3-d75232159098 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 200 len: 1274 microversion: 2.1 time: 0.142703 Oct 03 12:55:48.386660 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 345/685] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:48 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 1274 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:48.546134 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0dc9d273-ac3f-4735-b463-18aebf709f1f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:48.547074 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-0dc9d273-ac3f-4735-b463-18aebf709f1f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:48.556511 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0dc9d273-ac3f-4735-b463-18aebf709f1f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:48.557589 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0dc9d273-ac3f-4735-b463-18aebf709f1f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:48.558213 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0dc9d273-ac3f-4735-b463-18aebf709f1f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:48.559222 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0dc9d273-ac3f-4735-b463-18aebf709f1f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:48.559892 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0dc9d273-ac3f-4735-b463-18aebf709f1f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:48.560530 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0dc9d273-ac3f-4735-b463-18aebf709f1f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:48.729374 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0dc9d273-ac3f-4735-b463-18aebf709f1f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:48.741173 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0dc9d273-ac3f-4735-b463-18aebf709f1f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:48.746157 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0dc9d273-ac3f-4735-b463-18aebf709f1f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:48.750507 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-0dc9d273-ac3f-4735-b463-18aebf709f1f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1741 microversion: 2.20 time: 0.210230 Oct 03 12:55:48.751081 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 341/686] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:48 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1741 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:48.777131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-4f2be85d-700f-42cf-99db-2f19a6295574 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:48.778436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-4f2be85d-700f-42cf-99db-2f19a6295574 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:48.790115 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f2be85d-700f-42cf-99db-2f19a6295574 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:48.790865 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f2be85d-700f-42cf-99db-2f19a6295574 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:48.791529 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f2be85d-700f-42cf-99db-2f19a6295574 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:48.792428 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f2be85d-700f-42cf-99db-2f19a6295574 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:48.793042 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f2be85d-700f-42cf-99db-2f19a6295574 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:48.793623 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f2be85d-700f-42cf-99db-2f19a6295574 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:49.004412 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4f2be85d-700f-42cf-99db-2f19a6295574 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:49.013665 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-4f2be85d-700f-42cf-99db-2f19a6295574 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1264 microversion: 2.1 time: 0.240218 Oct 03 12:55:49.015048 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 346/687] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:48 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1264 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:49.418402 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-babb6d6b-3e94-434b-89bf-1da33550a529 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:49.419169 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-babb6d6b-3e94-434b-89bf-1da33550a529 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:49.421300 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:49.426457 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-babb6d6b-3e94-434b-89bf-1da33550a529 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:49.427122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-babb6d6b-3e94-434b-89bf-1da33550a529 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:49.427625 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-babb6d6b-3e94-434b-89bf-1da33550a529 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:49.428690 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-babb6d6b-3e94-434b-89bf-1da33550a529 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:49.428819 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-babb6d6b-3e94-434b-89bf-1da33550a529 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:49.429428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-babb6d6b-3e94-434b-89bf-1da33550a529 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:49.557940 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-babb6d6b-3e94-434b-89bf-1da33550a529 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b8ec0638764aba88e1920ecca7ddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead596751f234d79b38d661b0d5c6343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:49.573107 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-babb6d6b-3e94-434b-89bf-1da33550a529 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 200 len: 1272 microversion: 2.1 time: 0.158659 Oct 03 12:55:49.574026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 342/688] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:49 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:49.777775 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-5e62abeb-31a1-47ed-8bb4-3bdbb030c066 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:49.778611 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-5e62abeb-31a1-47ed-8bb4-3bdbb030c066 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:49.784794 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5e62abeb-31a1-47ed-8bb4-3bdbb030c066 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:49.785293 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5e62abeb-31a1-47ed-8bb4-3bdbb030c066 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:49.785736 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5e62abeb-31a1-47ed-8bb4-3bdbb030c066 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:49.787120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5e62abeb-31a1-47ed-8bb4-3bdbb030c066 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:49.787609 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5e62abeb-31a1-47ed-8bb4-3bdbb030c066 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:49.788044 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5e62abeb-31a1-47ed-8bb4-3bdbb030c066 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:49.904237 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a3ae65d2-6907-442f-b25a-7f102efe0b1f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:49.905272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a3ae65d2-6907-442f-b25a-7f102efe0b1f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:49.912188 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a3ae65d2-6907-442f-b25a-7f102efe0b1f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:49.912669 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a3ae65d2-6907-442f-b25a-7f102efe0b1f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:49.913117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a3ae65d2-6907-442f-b25a-7f102efe0b1f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:49.913824 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a3ae65d2-6907-442f-b25a-7f102efe0b1f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:49.914280 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a3ae65d2-6907-442f-b25a-7f102efe0b1f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:49.914741 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a3ae65d2-6907-442f-b25a-7f102efe0b1f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:49.942014 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:49.947104 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a3ae65d2-6907-442f-b25a-7f102efe0b1f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments/d2120452-f211-4fdd-a2be-5d2a7ab9bc66" status: 200 len: 194 microversion: 2.1 time: 0.047539 Oct 03 12:55:49.949552 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 343/689] 10.222.0.33 () {58 vars in 1413 bytes} [Mon Oct 3 12:55:49 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments/d2120452-f211-4fdd-a2be-5d2a7ab9bc66 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:55:49.960337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e1e6c11c-b9e1-4c13-aaba-771644548474 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:49.960849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e1e6c11c-b9e1-4c13-aaba-771644548474 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:49.962022 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5e62abeb-31a1-47ed-8bb4-3bdbb030c066 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:49.967083 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e1e6c11c-b9e1-4c13-aaba-771644548474 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:49.967608 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e1e6c11c-b9e1-4c13-aaba-771644548474 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:49.968216 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e1e6c11c-b9e1-4c13-aaba-771644548474 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:49.968917 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e1e6c11c-b9e1-4c13-aaba-771644548474 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:49.969547 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e1e6c11c-b9e1-4c13-aaba-771644548474 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:49.970009 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e1e6c11c-b9e1-4c13-aaba-771644548474 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:49.970527 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5e62abeb-31a1-47ed-8bb4-3bdbb030c066 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:49.972027 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5e62abeb-31a1-47ed-8bb4-3bdbb030c066 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:49.973249 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-5e62abeb-31a1-47ed-8bb4-3bdbb030c066 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1741 microversion: 2.20 time: 0.199558 Oct 03 12:55:49.973907 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 347/690] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:49 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:50.041380 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-24834a5a-5fbf-4e1b-b6c6-931958432d50 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:50.048851 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-24834a5a-5fbf-4e1b-b6c6-931958432d50 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:50.048851 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24834a5a-5fbf-4e1b-b6c6-931958432d50 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:50.048851 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24834a5a-5fbf-4e1b-b6c6-931958432d50 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:50.049157 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24834a5a-5fbf-4e1b-b6c6-931958432d50 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:50.049864 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24834a5a-5fbf-4e1b-b6c6-931958432d50 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:50.050320 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24834a5a-5fbf-4e1b-b6c6-931958432d50 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:50.050918 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24834a5a-5fbf-4e1b-b6c6-931958432d50 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:50.062983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-e1e6c11c-b9e1-4c13-aaba-771644548474 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lazy-loading 'services' on Instance uuid 03a5c967-4163-4841-ae8c-77d508c0ff59 {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:55:50.240871 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-24834a5a-5fbf-4e1b-b6c6-931958432d50 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:50.250305 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-24834a5a-5fbf-4e1b-b6c6-931958432d50 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1264 microversion: 2.1 time: 0.212299 Oct 03 12:55:50.251130 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 348/691] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:50 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1264 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:50.435356 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e1e6c11c-b9e1-4c13-aaba-771644548474 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments/d2120452-f211-4fdd-a2be-5d2a7ab9bc66" status: 202 len: 0 microversion: 2.1 time: 0.477004 Oct 03 12:55:50.436391 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 344/692] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 12:55:49 2022] DELETE /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments/d2120452-f211-4fdd-a2be-5d2a7ab9bc66 => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 12:55:50.599307 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d19b3fa2-98d7-49ec-bb82-2cfdef7c834f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:50.600425 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d19b3fa2-98d7-49ec-bb82-2cfdef7c834f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:50.626324 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d19b3fa2-98d7-49ec-bb82-2cfdef7c834f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:50.627526 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d19b3fa2-98d7-49ec-bb82-2cfdef7c834f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:50.628566 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d19b3fa2-98d7-49ec-bb82-2cfdef7c834f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:50.629708 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d19b3fa2-98d7-49ec-bb82-2cfdef7c834f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:50.630366 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d19b3fa2-98d7-49ec-bb82-2cfdef7c834f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:50.630908 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d19b3fa2-98d7-49ec-bb82-2cfdef7c834f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:50.660152 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:50.859607 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d19b3fa2-98d7-49ec-bb82-2cfdef7c834f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b8ec0638764aba88e1920ecca7ddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead596751f234d79b38d661b0d5c6343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:50.874379 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d19b3fa2-98d7-49ec-bb82-2cfdef7c834f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 200 len: 1314 microversion: 2.1 time: 0.280209 Oct 03 12:55:50.883268 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 349/693] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:50 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:51.001445 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a43a657c-cb2e-4e47-8f8c-f5dd10d79e45 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:51.002929 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a43a657c-cb2e-4e47-8f8c-f5dd10d79e45 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:51.012162 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a43a657c-cb2e-4e47-8f8c-f5dd10d79e45 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:51.018380 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a43a657c-cb2e-4e47-8f8c-f5dd10d79e45 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:51.018380 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a43a657c-cb2e-4e47-8f8c-f5dd10d79e45 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:51.018380 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a43a657c-cb2e-4e47-8f8c-f5dd10d79e45 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:51.018380 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a43a657c-cb2e-4e47-8f8c-f5dd10d79e45 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:51.018775 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a43a657c-cb2e-4e47-8f8c-f5dd10d79e45 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:51.261008 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a43a657c-cb2e-4e47-8f8c-f5dd10d79e45 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:51.269511 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a43a657c-cb2e-4e47-8f8c-f5dd10d79e45 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:51.271413 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a43a657c-cb2e-4e47-8f8c-f5dd10d79e45 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:51.272616 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a43a657c-cb2e-4e47-8f8c-f5dd10d79e45 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1741 microversion: 2.20 time: 0.275711 Oct 03 12:55:51.273167 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 345/694] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:50 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1741 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:55:51.274834 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-1c09b1c6-402c-49c3-aa52-343930fef88a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:51.275615 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-1c09b1c6-402c-49c3-aa52-343930fef88a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:51.282650 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1c09b1c6-402c-49c3-aa52-343930fef88a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:51.283219 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1c09b1c6-402c-49c3-aa52-343930fef88a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:51.283760 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1c09b1c6-402c-49c3-aa52-343930fef88a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:51.284626 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1c09b1c6-402c-49c3-aa52-343930fef88a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:51.285082 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1c09b1c6-402c-49c3-aa52-343930fef88a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:51.285503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1c09b1c6-402c-49c3-aa52-343930fef88a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:51.467155 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-1c09b1c6-402c-49c3-aa52-343930fef88a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:51.474958 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-1c09b1c6-402c-49c3-aa52-343930fef88a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1450 microversion: 2.1 time: 0.204555 Oct 03 12:55:51.475563 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 350/695] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:51 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1450 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:51.497689 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-27a8f79a-da10-42d0-970c-6173aad0f736 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:51.498305 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-27a8f79a-da10-42d0-970c-6173aad0f736 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:51.504285 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-27a8f79a-da10-42d0-970c-6173aad0f736 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:51.505500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-27a8f79a-da10-42d0-970c-6173aad0f736 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:51.505925 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-27a8f79a-da10-42d0-970c-6173aad0f736 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:51.506616 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-27a8f79a-da10-42d0-970c-6173aad0f736 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:51.507068 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-27a8f79a-da10-42d0-970c-6173aad0f736 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:51.507629 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-27a8f79a-da10-42d0-970c-6173aad0f736 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:51.723642 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-f4aa16b6-8825-4669-9008-3d7351654b77 req-23c2acc0-0113-4130-9128-b04dfdc281c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd3132e9-d468-48b0-9ce9-ae78593d7ee0", "tag": "e5c3ca65-7225-4ec8-a78b-053eba2d46bb"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:51.724018 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-27a8f79a-da10-42d0-970c-6173aad0f736 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:51.732489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-27a8f79a-da10-42d0-970c-6173aad0f736 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1450 microversion: 2.1 time: 0.238446 Oct 03 12:55:51.739626 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-f4aa16b6-8825-4669-9008-3d7351654b77 req-23c2acc0-0113-4130-9128-b04dfdc281c2 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:51.739626 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-f4aa16b6-8825-4669-9008-3d7351654b77 req-23c2acc0-0113-4130-9128-b04dfdc281c2 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:51.739626 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-f4aa16b6-8825-4669-9008-3d7351654b77 req-23c2acc0-0113-4130-9128-b04dfdc281c2 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:51.740894 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 346/696] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:51 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1450 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:51.762177 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-f4aa16b6-8825-4669-9008-3d7351654b77 req-23c2acc0-0113-4130-9128-b04dfdc281c2 service nova] Creating event network-changed:e5c3ca65-7225-4ec8-a78b-053eba2d46bb for instance cd3132e9-d468-48b0-9ce9-ae78593d7ee0 on hv-cinder-84456 Oct 03 12:55:51.773959 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-f4aa16b6-8825-4669-9008-3d7351654b77 req-23c2acc0-0113-4130-9128-b04dfdc281c2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243999 Oct 03 12:55:51.774572 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 351/697] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:55:51.906227 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8c55ecfb-0974-4c38-81b1-1bcc79696939 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:51.907106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8c55ecfb-0974-4c38-81b1-1bcc79696939 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:51.913357 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c55ecfb-0974-4c38-81b1-1bcc79696939 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:51.913854 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c55ecfb-0974-4c38-81b1-1bcc79696939 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:51.914304 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c55ecfb-0974-4c38-81b1-1bcc79696939 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:51.915010 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c55ecfb-0974-4c38-81b1-1bcc79696939 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:51.915499 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c55ecfb-0974-4c38-81b1-1bcc79696939 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:51.915927 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c55ecfb-0974-4c38-81b1-1bcc79696939 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:52.299802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-50de8087-e2ac-4f6d-b0cb-4f3dba321791 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:52.301399 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-50de8087-e2ac-4f6d-b0cb-4f3dba321791 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:52.308122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50de8087-e2ac-4f6d-b0cb-4f3dba321791 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:52.308807 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50de8087-e2ac-4f6d-b0cb-4f3dba321791 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:52.309429 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50de8087-e2ac-4f6d-b0cb-4f3dba321791 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:52.310133 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50de8087-e2ac-4f6d-b0cb-4f3dba321791 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:52.310786 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50de8087-e2ac-4f6d-b0cb-4f3dba321791 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:52.311548 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-50de8087-e2ac-4f6d-b0cb-4f3dba321791 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:52.474256 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8c55ecfb-0974-4c38-81b1-1bcc79696939 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b8ec0638764aba88e1920ecca7ddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead596751f234d79b38d661b0d5c6343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:52.482966 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8c55ecfb-0974-4c38-81b1-1bcc79696939 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 200 len: 1314 microversion: 2.1 time: 0.580594 Oct 03 12:55:52.495704 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 347/698] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:51 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 1314 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:52.566892 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-50de8087-e2ac-4f6d-b0cb-4f3dba321791 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:52.575413 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-50de8087-e2ac-4f6d-b0cb-4f3dba321791 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:52.576997 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-50de8087-e2ac-4f6d-b0cb-4f3dba321791 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:52.578172 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-50de8087-e2ac-4f6d-b0cb-4f3dba321791 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1723 microversion: 2.20 time: 0.283494 Oct 03 12:55:52.578762 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 352/699] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:52 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:55:52.710039 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-cce8562e-6df8-4c4f-a384-91f8acfbf4dc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:52.712386 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-cce8562e-6df8-4c4f-a384-91f8acfbf4dc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:52.718380 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cce8562e-6df8-4c4f-a384-91f8acfbf4dc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:52.718881 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cce8562e-6df8-4c4f-a384-91f8acfbf4dc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:52.719343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cce8562e-6df8-4c4f-a384-91f8acfbf4dc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:52.720067 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cce8562e-6df8-4c4f-a384-91f8acfbf4dc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:52.720530 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cce8562e-6df8-4c4f-a384-91f8acfbf4dc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:52.720962 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cce8562e-6df8-4c4f-a384-91f8acfbf4dc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:52.756136 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-cce8562e-6df8-4c4f-a384-91f8acfbf4dc tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051005 Oct 03 12:55:52.762459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 348/700] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 12:55:52 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 12:55:52.878909 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e7f52da7-aba3-4351-aef7-93aa632181e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:52.881719 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-e7f52da7-aba3-4351-aef7-93aa632181e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:52.887581 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e7f52da7-aba3-4351-aef7-93aa632181e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:52.888071 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e7f52da7-aba3-4351-aef7-93aa632181e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:52.888504 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e7f52da7-aba3-4351-aef7-93aa632181e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:52.889194 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e7f52da7-aba3-4351-aef7-93aa632181e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:52.889640 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e7f52da7-aba3-4351-aef7-93aa632181e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:52.890059 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e7f52da7-aba3-4351-aef7-93aa632181e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:52.919849 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e7f52da7-aba3-4351-aef7-93aa632181e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044791 Oct 03 12:55:52.920429 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 353/701] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 12:55:52 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 12:55:52.985015 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-81692abf-ea44-49a8-b4dc-4334ca5d9650 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:52.985516 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-81692abf-ea44-49a8-b4dc-4334ca5d9650 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:52.992241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-81692abf-ea44-49a8-b4dc-4334ca5d9650 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:52.992961 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-81692abf-ea44-49a8-b4dc-4334ca5d9650 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:53.001056 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-81692abf-ea44-49a8-b4dc-4334ca5d9650 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:53.001056 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-81692abf-ea44-49a8-b4dc-4334ca5d9650 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:53.001056 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-81692abf-ea44-49a8-b4dc-4334ca5d9650 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:53.001056 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-81692abf-ea44-49a8-b4dc-4334ca5d9650 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:53.021431 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-81692abf-ea44-49a8-b4dc-4334ca5d9650 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Going to try to terminate instance {{(pid=127542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:55:53.287683 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-81692abf-ea44-49a8-b4dc-4334ca5d9650 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 204 len: 0 microversion: 2.1 time: 0.306166 Oct 03 12:55:53.288274 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 349/702] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:55:52 2022] DELETE /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 12:55:53.296533 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-83c1bbb3-d768-4384-a404-2942dff18811 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:53.297150 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-83c1bbb3-d768-4384-a404-2942dff18811 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:53.303967 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-83c1bbb3-d768-4384-a404-2942dff18811 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:53.304576 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-83c1bbb3-d768-4384-a404-2942dff18811 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:53.304893 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-83c1bbb3-d768-4384-a404-2942dff18811 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:53.305596 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-83c1bbb3-d768-4384-a404-2942dff18811 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:53.306053 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-83c1bbb3-d768-4384-a404-2942dff18811 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:53.306480 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-83c1bbb3-d768-4384-a404-2942dff18811 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:53.479700 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-83c1bbb3-d768-4384-a404-2942dff18811 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:53.487942 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-83c1bbb3-d768-4384-a404-2942dff18811 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1672 microversion: 2.1 time: 0.195298 Oct 03 12:55:53.488509 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 354/703] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:53 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1672 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:55:53.508385 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c5e3125c-04c1-4ef9-a520-e7a105219ff5 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:53.509417 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c5e3125c-04c1-4ef9-a520-e7a105219ff5 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:53.515604 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5e3125c-04c1-4ef9-a520-e7a105219ff5 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:53.516658 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5e3125c-04c1-4ef9-a520-e7a105219ff5 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:53.517104 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5e3125c-04c1-4ef9-a520-e7a105219ff5 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:53.517808 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5e3125c-04c1-4ef9-a520-e7a105219ff5 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:53.518272 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5e3125c-04c1-4ef9-a520-e7a105219ff5 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:53.518819 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c5e3125c-04c1-4ef9-a520-e7a105219ff5 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:53.604721 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-80e476c8-2418-4d48-88fd-37f90415dc71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:53.605339 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-80e476c8-2418-4d48-88fd-37f90415dc71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:53.612138 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-80e476c8-2418-4d48-88fd-37f90415dc71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:53.612714 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-80e476c8-2418-4d48-88fd-37f90415dc71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:53.615706 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-80e476c8-2418-4d48-88fd-37f90415dc71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:53.616730 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-80e476c8-2418-4d48-88fd-37f90415dc71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:53.617208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-80e476c8-2418-4d48-88fd-37f90415dc71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:53.617777 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-80e476c8-2418-4d48-88fd-37f90415dc71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:53.673698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c5e3125c-04c1-4ef9-a520-e7a105219ff5 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b8ec0638764aba88e1920ecca7ddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead596751f234d79b38d661b0d5c6343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:53.683041 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c5e3125c-04c1-4ef9-a520-e7a105219ff5 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 200 len: 1314 microversion: 2.1 time: 0.179456 Oct 03 12:55:53.683899 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 350/704] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:53 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:55:53.761987 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-80e476c8-2418-4d48-88fd-37f90415dc71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:53.770896 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-80e476c8-2418-4d48-88fd-37f90415dc71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:53.772380 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-80e476c8-2418-4d48-88fd-37f90415dc71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:53.773543 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-80e476c8-2418-4d48-88fd-37f90415dc71 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1723 microversion: 2.20 time: 0.173442 Oct 03 12:55:53.774143 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 355/705] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:53 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:55:54.166224 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-e37c14ea-3d17-4774-98e4-9771384d9bab req-a1404326-eed3-4072-b03c-d254acd86339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0ce55bf-3f09-490a-baf4-0822672b5805", "tag": "e0d4db50-7910-4292-8ab0-c965757c89d7"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:54.177753 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-e37c14ea-3d17-4774-98e4-9771384d9bab req-a1404326-eed3-4072-b03c-d254acd86339 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:54.178237 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-e37c14ea-3d17-4774-98e4-9771384d9bab req-a1404326-eed3-4072-b03c-d254acd86339 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:54.178666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-e37c14ea-3d17-4774-98e4-9771384d9bab req-a1404326-eed3-4072-b03c-d254acd86339 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:54.189646 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-e37c14ea-3d17-4774-98e4-9771384d9bab req-a1404326-eed3-4072-b03c-d254acd86339 service nova] Creating event network-changed:e0d4db50-7910-4292-8ab0-c965757c89d7 for instance b0ce55bf-3f09-490a-baf4-0822672b5805 on hv-cinder-84456 Oct 03 12:55:54.195753 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-e37c14ea-3d17-4774-98e4-9771384d9bab req-a1404326-eed3-4072-b03c-d254acd86339 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033247 Oct 03 12:55:54.196350 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 351/706] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:55:54.511851 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-51cd9dcb-fbb8-494f-9287-8cc8679b10e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:54.512505 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-51cd9dcb-fbb8-494f-9287-8cc8679b10e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:54.518917 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-51cd9dcb-fbb8-494f-9287-8cc8679b10e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:54.519436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-51cd9dcb-fbb8-494f-9287-8cc8679b10e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:54.519873 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-51cd9dcb-fbb8-494f-9287-8cc8679b10e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:54.520791 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-51cd9dcb-fbb8-494f-9287-8cc8679b10e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:54.521260 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-51cd9dcb-fbb8-494f-9287-8cc8679b10e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:54.521688 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-51cd9dcb-fbb8-494f-9287-8cc8679b10e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:54.652328 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-51cd9dcb-fbb8-494f-9287-8cc8679b10e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:54.666751 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-51cd9dcb-fbb8-494f-9287-8cc8679b10e4 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1672 microversion: 2.1 time: 0.158669 Oct 03 12:55:54.667416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 356/707] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:54 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:54.703175 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:54.707289 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8d7d90a5-783a-4e70-b296-b6dcc4dd8248 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:54.708179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8d7d90a5-783a-4e70-b296-b6dcc4dd8248 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:54.714207 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d7d90a5-783a-4e70-b296-b6dcc4dd8248 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:54.714699 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d7d90a5-783a-4e70-b296-b6dcc4dd8248 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:54.715133 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d7d90a5-783a-4e70-b296-b6dcc4dd8248 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:54.715857 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d7d90a5-783a-4e70-b296-b6dcc4dd8248 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:54.716309 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d7d90a5-783a-4e70-b296-b6dcc4dd8248 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:54.716732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d7d90a5-783a-4e70-b296-b6dcc4dd8248 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:54.799705 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-f5c6c369-51bf-4707-80d5-862b4f4ed78e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:54.800346 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-f5c6c369-51bf-4707-80d5-862b4f4ed78e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:54.807610 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f5c6c369-51bf-4707-80d5-862b4f4ed78e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:54.808413 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f5c6c369-51bf-4707-80d5-862b4f4ed78e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:54.808851 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f5c6c369-51bf-4707-80d5-862b4f4ed78e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:54.809925 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f5c6c369-51bf-4707-80d5-862b4f4ed78e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:54.810384 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f5c6c369-51bf-4707-80d5-862b4f4ed78e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:54.810805 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f5c6c369-51bf-4707-80d5-862b4f4ed78e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:54.888208 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8d7d90a5-783a-4e70-b296-b6dcc4dd8248 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b8ec0638764aba88e1920ecca7ddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead596751f234d79b38d661b0d5c6343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:54.897516 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8d7d90a5-783a-4e70-b296-b6dcc4dd8248 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 200 len: 1314 microversion: 2.1 time: 0.195148 Oct 03 12:55:54.900618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 352/708] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:54 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:54.934650 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=2 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:55.091923 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-f5c6c369-51bf-4707-80d5-862b4f4ed78e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:55.100418 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-f5c6c369-51bf-4707-80d5-862b4f4ed78e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:55.102023 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-f5c6c369-51bf-4707-80d5-862b4f4ed78e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:55.103517 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-f5c6c369-51bf-4707-80d5-862b4f4ed78e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1723 microversion: 2.20 time: 0.307763 Oct 03 12:55:55.104074 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 357/709] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:54 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:55:55.577228 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-fd37cc3f-6f6c-4b3f-a136-891e9b108390 req-72c15f04-ba85-423e-8bc0-a9bc40b8037d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b37dd24-5a6e-4898-8247-8e00786088ea", "name": "network-vif-unplugged", "status": "completed", "tag": "778fd61a-2cb6-43b5-ad14-c9a69f32bf7c"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:55.588413 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-fd37cc3f-6f6c-4b3f-a136-891e9b108390 req-72c15f04-ba85-423e-8bc0-a9bc40b8037d service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:55.588917 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-fd37cc3f-6f6c-4b3f-a136-891e9b108390 req-72c15f04-ba85-423e-8bc0-a9bc40b8037d service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:55.589341 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-fd37cc3f-6f6c-4b3f-a136-891e9b108390 req-72c15f04-ba85-423e-8bc0-a9bc40b8037d service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:55.601396 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-fd37cc3f-6f6c-4b3f-a136-891e9b108390 req-72c15f04-ba85-423e-8bc0-a9bc40b8037d service nova] Creating event network-vif-unplugged:778fd61a-2cb6-43b5-ad14-c9a69f32bf7c for instance 6b37dd24-5a6e-4898-8247-8e00786088ea on hv-cinder-84456 Oct 03 12:55:55.606894 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-fd37cc3f-6f6c-4b3f-a136-891e9b108390 req-72c15f04-ba85-423e-8bc0-a9bc40b8037d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033581 Oct 03 12:55:55.607568 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 353/710] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:55:55.689847 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0253a55d-fa12-4bea-ba8c-ac3d3f149552 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:55.690455 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-0253a55d-fa12-4bea-ba8c-ac3d3f149552 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:55.697866 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0253a55d-fa12-4bea-ba8c-ac3d3f149552 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:55.698362 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0253a55d-fa12-4bea-ba8c-ac3d3f149552 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:55.698805 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0253a55d-fa12-4bea-ba8c-ac3d3f149552 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:55.699538 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0253a55d-fa12-4bea-ba8c-ac3d3f149552 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:55.699999 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0253a55d-fa12-4bea-ba8c-ac3d3f149552 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:55.700436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0253a55d-fa12-4bea-ba8c-ac3d3f149552 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:55.831739 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0253a55d-fa12-4bea-ba8c-ac3d3f149552 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:55.840201 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0253a55d-fa12-4bea-ba8c-ac3d3f149552 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1672 microversion: 2.1 time: 0.154258 Oct 03 12:55:55.840782 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 358/711] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:55 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:55.921246 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e0109f86-a7aa-466e-b556-3ed04e0236a3 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:55.921892 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e0109f86-a7aa-466e-b556-3ed04e0236a3 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:55.928123 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e0109f86-a7aa-466e-b556-3ed04e0236a3 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:55.928609 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e0109f86-a7aa-466e-b556-3ed04e0236a3 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:55.929049 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e0109f86-a7aa-466e-b556-3ed04e0236a3 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:55.929730 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e0109f86-a7aa-466e-b556-3ed04e0236a3 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:55.930178 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e0109f86-a7aa-466e-b556-3ed04e0236a3 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:55.930602 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e0109f86-a7aa-466e-b556-3ed04e0236a3 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:56.049613 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=8 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:56.065863 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e0109f86-a7aa-466e-b556-3ed04e0236a3 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b8ec0638764aba88e1920ecca7ddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead596751f234d79b38d661b0d5c6343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:56.074199 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e0109f86-a7aa-466e-b556-3ed04e0236a3 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 200 len: 1314 microversion: 2.1 time: 0.157216 Oct 03 12:55:56.074785 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 354/712] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:55 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:56.129916 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-6fad6fee-ea74-4bd7-b557-1d02ae02d12e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:56.130809 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-6fad6fee-ea74-4bd7-b557-1d02ae02d12e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:56.136751 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6fad6fee-ea74-4bd7-b557-1d02ae02d12e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:56.137235 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6fad6fee-ea74-4bd7-b557-1d02ae02d12e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:56.137672 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6fad6fee-ea74-4bd7-b557-1d02ae02d12e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:56.138366 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6fad6fee-ea74-4bd7-b557-1d02ae02d12e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:56.138815 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6fad6fee-ea74-4bd7-b557-1d02ae02d12e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:56.139232 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6fad6fee-ea74-4bd7-b557-1d02ae02d12e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:56.272595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-6fad6fee-ea74-4bd7-b557-1d02ae02d12e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:56.280685 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-6fad6fee-ea74-4bd7-b557-1d02ae02d12e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:56.282231 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-6fad6fee-ea74-4bd7-b557-1d02ae02d12e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:56.283415 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-6fad6fee-ea74-4bd7-b557-1d02ae02d12e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1723 microversion: 2.20 time: 0.157862 Oct 03 12:55:56.283971 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 359/713] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:56 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:55:56.867894 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-53ac0203-6bb8-491e-a73e-c393fe594e98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:56.868520 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-53ac0203-6bb8-491e-a73e-c393fe594e98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:56.875168 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53ac0203-6bb8-491e-a73e-c393fe594e98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:56.876601 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53ac0203-6bb8-491e-a73e-c393fe594e98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:56.877198 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53ac0203-6bb8-491e-a73e-c393fe594e98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:56.878072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53ac0203-6bb8-491e-a73e-c393fe594e98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:56.878679 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53ac0203-6bb8-491e-a73e-c393fe594e98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:56.879491 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-53ac0203-6bb8-491e-a73e-c393fe594e98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:57.099949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-71e9eae7-7e95-4890-921d-66d41354d0b7 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:57.100572 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-71e9eae7-7e95-4890-921d-66d41354d0b7 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:57.108215 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-71e9eae7-7e95-4890-921d-66d41354d0b7 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:57.109117 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-71e9eae7-7e95-4890-921d-66d41354d0b7 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:57.110007 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-71e9eae7-7e95-4890-921d-66d41354d0b7 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:57.110726 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-71e9eae7-7e95-4890-921d-66d41354d0b7 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:57.112167 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-71e9eae7-7e95-4890-921d-66d41354d0b7 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:57.112929 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-71e9eae7-7e95-4890-921d-66d41354d0b7 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:57.201744 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-53ac0203-6bb8-491e-a73e-c393fe594e98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:57.215635 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-53ac0203-6bb8-491e-a73e-c393fe594e98 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1672 microversion: 2.1 time: 0.355098 Oct 03 12:55:57.216957 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 355/714] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:56 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1672 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:57.312345 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-32d9610d-c6f1-46c1-889e-74469f2cd7f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:57.312345 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-32d9610d-c6f1-46c1-889e-74469f2cd7f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:57.322799 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-32d9610d-c6f1-46c1-889e-74469f2cd7f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:57.323477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-32d9610d-c6f1-46c1-889e-74469f2cd7f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:57.324007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-32d9610d-c6f1-46c1-889e-74469f2cd7f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:57.324834 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-32d9610d-c6f1-46c1-889e-74469f2cd7f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:57.325567 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-32d9610d-c6f1-46c1-889e-74469f2cd7f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:57.326146 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-32d9610d-c6f1-46c1-889e-74469f2cd7f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:57.438918 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-71e9eae7-7e95-4890-921d-66d41354d0b7 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b8ec0638764aba88e1920ecca7ddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead596751f234d79b38d661b0d5c6343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:57.449271 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-71e9eae7-7e95-4890-921d-66d41354d0b7 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 200 len: 1314 microversion: 2.1 time: 0.355125 Oct 03 12:55:57.454376 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 360/715] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:57 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:57.520787 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-32d9610d-c6f1-46c1-889e-74469f2cd7f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:57.533456 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-32d9610d-c6f1-46c1-889e-74469f2cd7f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:57.537892 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-32d9610d-c6f1-46c1-889e-74469f2cd7f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:57.542551 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-32d9610d-c6f1-46c1-889e-74469f2cd7f0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1726 microversion: 2.20 time: 0.237237 Oct 03 12:55:57.554496 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 356/716] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:57 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1726 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:55:57.571461 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a71ba963-4eee-4c03-87a0-2ead405aca5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5bc063f-0716-4122-bb7c-d3c485b484e2"}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:57.573955 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a71ba963-4eee-4c03-87a0-2ead405aca5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:57.580461 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a71ba963-4eee-4c03-87a0-2ead405aca5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:57.586107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a71ba963-4eee-4c03-87a0-2ead405aca5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:57.586107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a71ba963-4eee-4c03-87a0-2ead405aca5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:57.586107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a71ba963-4eee-4c03-87a0-2ead405aca5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:57.586107 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a71ba963-4eee-4c03-87a0-2ead405aca5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:57.586503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a71ba963-4eee-4c03-87a0-2ead405aca5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:57.665438 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-5df17599-e020-482b-bcad-6f7e7ca28ea8 req-8c18cf94-6140-40c7-a44c-78fea9fbb4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd3132e9-d468-48b0-9ce9-ae78593d7ee0", "name": "network-vif-plugged", "status": "completed", "tag": "e5c3ca65-7225-4ec8-a78b-053eba2d46bb"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:57.695512 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-5df17599-e020-482b-bcad-6f7e7ca28ea8 req-8c18cf94-6140-40c7-a44c-78fea9fbb4d6 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:57.696268 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-5df17599-e020-482b-bcad-6f7e7ca28ea8 req-8c18cf94-6140-40c7-a44c-78fea9fbb4d6 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:57.696846 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-5df17599-e020-482b-bcad-6f7e7ca28ea8 req-8c18cf94-6140-40c7-a44c-78fea9fbb4d6 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:57.717780 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-5df17599-e020-482b-bcad-6f7e7ca28ea8 req-8c18cf94-6140-40c7-a44c-78fea9fbb4d6 service nova] Creating event network-vif-plugged:e5c3ca65-7225-4ec8-a78b-053eba2d46bb for instance cd3132e9-d468-48b0-9ce9-ae78593d7ee0 on hv-cinder-84456 Oct 03 12:55:57.724909 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-5df17599-e020-482b-bcad-6f7e7ca28ea8 req-8c18cf94-6140-40c7-a44c-78fea9fbb4d6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065645 Oct 03 12:55:57.724909 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 357/717] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:55:57.901714 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-97a1afc3-58b7-4b69-9050-d440dd2e009f req-c4edaf72-591e-4f64-87ff-51a416044022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a5c967-4163-4841-ae8c-77d508c0ff59", "name": "network-vif-deleted", "tag": "cf688afb-8bbc-40e1-934b-cdf7069fca35"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:57.912395 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-97a1afc3-58b7-4b69-9050-d440dd2e009f req-c4edaf72-591e-4f64-87ff-51a416044022 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:57.912892 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-97a1afc3-58b7-4b69-9050-d440dd2e009f req-c4edaf72-591e-4f64-87ff-51a416044022 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:57.913326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-97a1afc3-58b7-4b69-9050-d440dd2e009f req-c4edaf72-591e-4f64-87ff-51a416044022 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:57.924614 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-97a1afc3-58b7-4b69-9050-d440dd2e009f req-c4edaf72-591e-4f64-87ff-51a416044022 service nova] Creating event network-vif-deleted:cf688afb-8bbc-40e1-934b-cdf7069fca35 for instance 03a5c967-4163-4841-ae8c-77d508c0ff59 on hv-cinder-84456 Oct 03 12:55:57.930000 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-97a1afc3-58b7-4b69-9050-d440dd2e009f req-c4edaf72-591e-4f64-87ff-51a416044022 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032736 Oct 03 12:55:57.931088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 358/718] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:55:58.241590 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-5b6f7178-1198-4bbd-bed6-faff09e73416 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:58.242299 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-5b6f7178-1198-4bbd-bed6-faff09e73416 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:58.252180 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5b6f7178-1198-4bbd-bed6-faff09e73416 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:58.252858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5b6f7178-1198-4bbd-bed6-faff09e73416 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:58.253302 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5b6f7178-1198-4bbd-bed6-faff09e73416 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:58.254021 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5b6f7178-1198-4bbd-bed6-faff09e73416 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:58.255089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5b6f7178-1198-4bbd-bed6-faff09e73416 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:58.255582 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5b6f7178-1198-4bbd-bed6-faff09e73416 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:58.292867 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5b6f7178-1198-4bbd-bed6-faff09e73416 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:58.293395 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5b6f7178-1198-4bbd-bed6-faff09e73416 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:58.293840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5b6f7178-1198-4bbd-bed6-faff09e73416 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:58.294294 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-5b6f7178-1198-4bbd-bed6-faff09e73416 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lazy-loading 'fault' on Instance uuid 03a5c967-4163-4841-ae8c-77d508c0ff59 {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:55:58.351054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-5b6f7178-1198-4bbd-bed6-faff09e73416 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:58.363174 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-5b6f7178-1198-4bbd-bed6-faff09e73416 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1326 microversion: 2.1 time: 0.126891 Oct 03 12:55:58.382115 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 359/719] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:58 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1326 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:58.475248 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-2a6e5d79-42b7-4961-911b-40b69db0ce5f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:58.475908 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-2a6e5d79-42b7-4961-911b-40b69db0ce5f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:58.482078 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2a6e5d79-42b7-4961-911b-40b69db0ce5f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:58.482583 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2a6e5d79-42b7-4961-911b-40b69db0ce5f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:58.483026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2a6e5d79-42b7-4961-911b-40b69db0ce5f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:58.483770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2a6e5d79-42b7-4961-911b-40b69db0ce5f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:58.484282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2a6e5d79-42b7-4961-911b-40b69db0ce5f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:58.484950 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2a6e5d79-42b7-4961-911b-40b69db0ce5f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:58.509498 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:58.612572 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a71ba963-4eee-4c03-87a0-2ead405aca5c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "POST /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.046245 Oct 03 12:55:58.615228 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 361/720] 10.222.0.33 () {62 vars in 1364 bytes} [Mon Oct 3 12:55:57 2022] POST /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea/os-volume_attachments => generated 188 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:55:58.641607 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-2a6e5d79-42b7-4961-911b-40b69db0ce5f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b8ec0638764aba88e1920ecca7ddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead596751f234d79b38d661b0d5c6343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:58.651299 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-2a6e5d79-42b7-4961-911b-40b69db0ce5f tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 200 len: 1314 microversion: 2.1 time: 0.181955 Oct 03 12:55:58.656646 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 360/721] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:58 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:55:58.747440 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a9560ac7-07df-4ec1-8006-797a9624e2cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:58.747968 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a9560ac7-07df-4ec1-8006-797a9624e2cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:58.753987 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a9560ac7-07df-4ec1-8006-797a9624e2cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:58.755174 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a9560ac7-07df-4ec1-8006-797a9624e2cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:58.755666 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a9560ac7-07df-4ec1-8006-797a9624e2cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:58.756464 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a9560ac7-07df-4ec1-8006-797a9624e2cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:58.756919 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a9560ac7-07df-4ec1-8006-797a9624e2cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:58.757343 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a9560ac7-07df-4ec1-8006-797a9624e2cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:58.907039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:59.390109 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-5152f02f-a82b-4462-927b-116521c3f9a1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:59.391180 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-5152f02f-a82b-4462-927b-116521c3f9a1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:59.399571 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5152f02f-a82b-4462-927b-116521c3f9a1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:59.400149 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5152f02f-a82b-4462-927b-116521c3f9a1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:59.400602 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5152f02f-a82b-4462-927b-116521c3f9a1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:59.401370 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5152f02f-a82b-4462-927b-116521c3f9a1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:59.401832 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5152f02f-a82b-4462-927b-116521c3f9a1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:59.402265 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5152f02f-a82b-4462-927b-116521c3f9a1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:59.435468 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5152f02f-a82b-4462-927b-116521c3f9a1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:59.435954 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5152f02f-a82b-4462-927b-116521c3f9a1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:59.436388 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5152f02f-a82b-4462-927b-116521c3f9a1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:59.436833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-5152f02f-a82b-4462-927b-116521c3f9a1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lazy-loading 'fault' on Instance uuid 03a5c967-4163-4841-ae8c-77d508c0ff59 {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:55:59.440995 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a9560ac7-07df-4ec1-8006-797a9624e2cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea/os-volume_attachments/c5bc063f-0716-4122-bb7c-d3c485b484e2" status: 202 len: 0 microversion: 2.20 time: 0.697516 Oct 03 12:55:59.446857 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 362/722] 10.222.0.33 () {60 vars in 1457 bytes} [Mon Oct 3 12:55:58 2022] DELETE /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea/os-volume_attachments/c5bc063f-0716-4122-bb7c-d3c485b484e2 => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:55:59.482596 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-5152f02f-a82b-4462-927b-116521c3f9a1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd24d209dc9644e8b2860a0e676acd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc40d256f0e24050b6b53fdbcbce1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:55:59.492398 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-5152f02f-a82b-4462-927b-116521c3f9a1 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 200 len: 1326 microversion: 2.1 time: 0.106445 Oct 03 12:55:59.492970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 361/723] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:59 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 1326 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:55:59.522494 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8e845135-c133-467d-9a16-f5ac85f2d194 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:59.523027 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8e845135-c133-467d-9a16-f5ac85f2d194 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:59.529462 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e845135-c133-467d-9a16-f5ac85f2d194 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:59.529941 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e845135-c133-467d-9a16-f5ac85f2d194 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:59.530380 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e845135-c133-467d-9a16-f5ac85f2d194 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:59.531069 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e845135-c133-467d-9a16-f5ac85f2d194 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:59.531560 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e845135-c133-467d-9a16-f5ac85f2d194 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:59.531984 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8e845135-c133-467d-9a16-f5ac85f2d194 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:59.561876 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8e845135-c133-467d-9a16-f5ac85f2d194 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127544) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 12:55:59.578701 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3d178061-49fe-4202-853f-577131938f08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:55:59.579369 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3d178061-49fe-4202-853f-577131938f08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:59.588068 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3d178061-49fe-4202-853f-577131938f08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:59.588567 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3d178061-49fe-4202-853f-577131938f08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:59.589011 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3d178061-49fe-4202-853f-577131938f08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:59.589718 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3d178061-49fe-4202-853f-577131938f08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:59.590178 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3d178061-49fe-4202-853f-577131938f08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:59.590608 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3d178061-49fe-4202-853f-577131938f08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:59.614626 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-3d178061-49fe-4202-853f-577131938f08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lazy-loading 'flavor' on Instance uuid e3a54301-d1b8-4060-b712-8d707bcfbef5 {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:55:59.872251 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-8e845135-c133-467d-9a16-f5ac85f2d194 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "POST /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea/action" status: 202 len: 0 microversion: 2.20 time: 0.354401 Oct 03 12:55:59.872849 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 363/724] 10.222.0.33 () {62 vars in 1319 bytes} [Mon Oct 3 12:55:59 2022] POST /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:55:59.877559 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-04ed1f32-3b77-4796-9bb7-9e1d49843395 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:59.878179 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-04ed1f32-3b77-4796-9bb7-9e1d49843395 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:59.885224 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-04ed1f32-3b77-4796-9bb7-9e1d49843395 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:59.885667 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-04ed1f32-3b77-4796-9bb7-9e1d49843395 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:59.886106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-04ed1f32-3b77-4796-9bb7-9e1d49843395 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:59.886841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-04ed1f32-3b77-4796-9bb7-9e1d49843395 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:59.887433 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-04ed1f32-3b77-4796-9bb7-9e1d49843395 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:59.887869 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-04ed1f32-3b77-4796-9bb7-9e1d49843395 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:59.959475 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3d178061-49fe-4202-853f-577131938f08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "POST /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5/action" status: 202 len: 0 microversion: 2.1 time: 0.384073 Oct 03 12:55:59.959475 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 362/725] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 12:55:59 2022] POST /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 12:55:59.967143 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d086a846-2253-463c-9062-4579f47af0cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:55:59.978549 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d086a846-2253-463c-9062-4579f47af0cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:55:59.978549 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d086a846-2253-463c-9062-4579f47af0cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:59.979087 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d086a846-2253-463c-9062-4579f47af0cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:59.979284 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d086a846-2253-463c-9062-4579f47af0cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:55:59.980009 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d086a846-2253-463c-9062-4579f47af0cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:55:59.980467 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d086a846-2253-463c-9062-4579f47af0cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:55:59.980888 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d086a846-2253-463c-9062-4579f47af0cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:00.024821 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-04ed1f32-3b77-4796-9bb7-9e1d49843395 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b8ec0638764aba88e1920ecca7ddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead596751f234d79b38d661b0d5c6343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:00.033305 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-04ed1f32-3b77-4796-9bb7-9e1d49843395 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 200 len: 1464 microversion: 2.1 time: 0.159445 Oct 03 12:56:00.033885 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 364/726] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:55:59 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:00.039038 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e75328a6-289f-4583-b099-5e214b228a38 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:00.039678 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-e75328a6-289f-4583-b099-5e214b228a38 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:00.045964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e75328a6-289f-4583-b099-5e214b228a38 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:00.046450 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e75328a6-289f-4583-b099-5e214b228a38 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:00.046940 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e75328a6-289f-4583-b099-5e214b228a38 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:00.050917 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e75328a6-289f-4583-b099-5e214b228a38 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:00.051613 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e75328a6-289f-4583-b099-5e214b228a38 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:00.052236 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e75328a6-289f-4583-b099-5e214b228a38 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:00.185043 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d086a846-2253-463c-9062-4579f47af0cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:00.194638 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d086a846-2253-463c-9062-4579f47af0cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:00.196260 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d086a846-2253-463c-9062-4579f47af0cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:00.197449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d086a846-2253-463c-9062-4579f47af0cd tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1674 microversion: 2.20 time: 0.234421 Oct 03 12:56:00.198220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 363/727] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:55:59 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1674 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:56:00.202461 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b4d729ac-5fe6-49dd-a05e-414aa8cee6bb tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:00.202963 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b4d729ac-5fe6-49dd-a05e-414aa8cee6bb tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:00.209604 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4d729ac-5fe6-49dd-a05e-414aa8cee6bb tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:00.210100 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4d729ac-5fe6-49dd-a05e-414aa8cee6bb tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:00.210542 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4d729ac-5fe6-49dd-a05e-414aa8cee6bb tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:00.211248 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4d729ac-5fe6-49dd-a05e-414aa8cee6bb tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:00.211734 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4d729ac-5fe6-49dd-a05e-414aa8cee6bb tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:00.212159 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b4d729ac-5fe6-49dd-a05e-414aa8cee6bb tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:00.237419 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b4d729ac-5fe6-49dd-a05e-414aa8cee6bb tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Going to try to terminate instance {{(pid=127542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:56:00.263010 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e75328a6-289f-4583-b099-5e214b228a38 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:00.270995 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e75328a6-289f-4583-b099-5e214b228a38 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1569 microversion: 2.1 time: 0.235984 Oct 03 12:56:00.271851 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 365/728] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:00 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1569 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:00.515960 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-472dec24-1652-466a-b2ff-d44969b0fb4f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:00.516569 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-472dec24-1652-466a-b2ff-d44969b0fb4f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:00.522472 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-472dec24-1652-466a-b2ff-d44969b0fb4f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:00.522961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-472dec24-1652-466a-b2ff-d44969b0fb4f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:00.523419 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-472dec24-1652-466a-b2ff-d44969b0fb4f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:00.524104 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-472dec24-1652-466a-b2ff-d44969b0fb4f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:00.524589 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-472dec24-1652-466a-b2ff-d44969b0fb4f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:00.525009 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-472dec24-1652-466a-b2ff-d44969b0fb4f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:00.538804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-472dec24-1652-466a-b2ff-d44969b0fb4f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] HTTP exception thrown: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-472dec24-1652-466a-b2ff-d44969b0fb4f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Request method failure captured: Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 HTTP/1.1 Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtpqveAWd5CfrsBJwJ-Bq-Llx8KmrbMxOIBesMnErADsus0b_wqY-2tmcSYAAz2WfEJ7g-jJZEnFBk9mJ4D5lxpIvp8Y1RcIXWQiqIZkavte4X7fbzVp0l8551bmo8lX1QJOgKeKQkz1VzGt6VpqDhc35pWwkzdfdezYsA_Ijwfe7OQ Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: cc40d256f0e24050b6b53fdbcbce1962 Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 12:56:00.541409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 12:56:00.543006 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:56:00.543006 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:56:00.543006 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: cc40d256f0e24050b6b53fdbcbce1962 Oct 03 12:56:00.543006 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:56:00.543006 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-AttachVolumeTestJSON-1115138470-project Oct 03 12:56:00.543006 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 12:56:00.543006 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 12:56:00.543006 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: bd24d209dc9644e8b2860a0e676acd3b Oct 03 12:56:00.543006 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-AttachVolumeTestJSON-1115138470-project Oct 03 12:56:00.543006 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 12:56:00.543006 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. Oct 03 12:56:00.543006 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': '03a5c967-4163-4841-ae8c-77d508c0ff59'} Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:56:00.543961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. Oct 03 12:56:00.545554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:56:00.547043 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-472dec24-1652-466a-b2ff-d44969b0fb4f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Returning 404 to user: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:56:00.547043 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-472dec24-1652-466a-b2ff-d44969b0fb4f tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 404 len: 111 microversion: 2.1 time: 0.030006 Oct 03 12:56:00.547043 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 366/729] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:00 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 12:56:00.550526 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3228ee7a-1a7a-4abe-9a88-e4925832688a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '.version_select at 0x7fc7400f5820>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:00.561514 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-b4d729ac-5fe6-49dd-a05e-414aa8cee6bb tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 204 len: 0 microversion: 2.1 time: 0.362267 Oct 03 12:56:00.562106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 364/730] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:56:00 2022] DELETE /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:56:00.570636 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-786aa7d2-4759-4bba-b5f5-a42446062657 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:00.575959 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-786aa7d2-4759-4bba-b5f5-a42446062657 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:00.577890 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-786aa7d2-4759-4bba-b5f5-a42446062657 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:00.578381 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-786aa7d2-4759-4bba-b5f5-a42446062657 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:00.578823 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-786aa7d2-4759-4bba-b5f5-a42446062657 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:00.579556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-786aa7d2-4759-4bba-b5f5-a42446062657 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:00.580022 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-786aa7d2-4759-4bba-b5f5-a42446062657 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:00.580451 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-786aa7d2-4759-4bba-b5f5-a42446062657 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:00.636586 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-3228ee7a-1a7a-4abe-9a88-e4925832688a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-589992174" status: 202 len: 0 microversion: 2.1 time: 0.089619 Oct 03 12:56:00.637195 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 367/731] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Oct 3 12:56:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-589992174 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 12:56:00.718843 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-786aa7d2-4759-4bba-b5f5-a42446062657 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b8ec0638764aba88e1920ecca7ddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead596751f234d79b38d661b0d5c6343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:00.727535 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-786aa7d2-4759-4bba-b5f5-a42446062657 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 200 len: 1470 microversion: 2.1 time: 0.160983 Oct 03 12:56:00.729939 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 365/732] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:00 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:01.224156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9462e663-9c3b-4fb8-9a08-f4da6eb34f61 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:01.224759 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-9462e663-9c3b-4fb8-9a08-f4da6eb34f61 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:01.231379 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9462e663-9c3b-4fb8-9a08-f4da6eb34f61 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:01.231868 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9462e663-9c3b-4fb8-9a08-f4da6eb34f61 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:01.232324 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9462e663-9c3b-4fb8-9a08-f4da6eb34f61 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:01.233145 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9462e663-9c3b-4fb8-9a08-f4da6eb34f61 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:01.233605 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9462e663-9c3b-4fb8-9a08-f4da6eb34f61 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:01.234033 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9462e663-9c3b-4fb8-9a08-f4da6eb34f61 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:01.294278 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-748c29f1-ea66-4069-9f12-16a1c192c75f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:01.294814 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-748c29f1-ea66-4069-9f12-16a1c192c75f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:01.300795 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-748c29f1-ea66-4069-9f12-16a1c192c75f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:01.301861 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-748c29f1-ea66-4069-9f12-16a1c192c75f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:01.302458 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-748c29f1-ea66-4069-9f12-16a1c192c75f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:01.303172 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-748c29f1-ea66-4069-9f12-16a1c192c75f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:01.303661 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-748c29f1-ea66-4069-9f12-16a1c192c75f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:01.304088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-748c29f1-ea66-4069-9f12-16a1c192c75f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:01.407250 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9462e663-9c3b-4fb8-9a08-f4da6eb34f61 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:01.417237 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9462e663-9c3b-4fb8-9a08-f4da6eb34f61 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:01.420426 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9462e663-9c3b-4fb8-9a08-f4da6eb34f61 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:01.421757 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-9462e663-9c3b-4fb8-9a08-f4da6eb34f61 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1674 microversion: 2.20 time: 0.202163 Oct 03 12:56:01.423660 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 368/733] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:01 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1674 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:56:01.470614 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-748c29f1-ea66-4069-9f12-16a1c192c75f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:01.478970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-748c29f1-ea66-4069-9f12-16a1c192c75f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1569 microversion: 2.1 time: 0.188702 Oct 03 12:56:01.479572 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 366/734] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:01 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:01.751339 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a6d6243c-db66-4032-9011-1ff5bf78bcd4 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:01.751976 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a6d6243c-db66-4032-9011-1ff5bf78bcd4 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:01.758157 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6d6243c-db66-4032-9011-1ff5bf78bcd4 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:01.758643 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6d6243c-db66-4032-9011-1ff5bf78bcd4 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:01.759076 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6d6243c-db66-4032-9011-1ff5bf78bcd4 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:01.759902 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6d6243c-db66-4032-9011-1ff5bf78bcd4 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:01.760361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6d6243c-db66-4032-9011-1ff5bf78bcd4 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:01.760785 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6d6243c-db66-4032-9011-1ff5bf78bcd4 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:01.897104 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-a6d6243c-db66-4032-9011-1ff5bf78bcd4 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b8ec0638764aba88e1920ecca7ddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead596751f234d79b38d661b0d5c6343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:01.904909 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a6d6243c-db66-4032-9011-1ff5bf78bcd4 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 200 len: 1470 microversion: 2.1 time: 0.157420 Oct 03 12:56:01.905539 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 369/735] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:01 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:02.447923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-35fe01fa-333f-40f1-bea9-b9ff06b89994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:02.448538 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-35fe01fa-333f-40f1-bea9-b9ff06b89994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:02.455043 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-35fe01fa-333f-40f1-bea9-b9ff06b89994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:02.455574 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-35fe01fa-333f-40f1-bea9-b9ff06b89994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:02.456209 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-35fe01fa-333f-40f1-bea9-b9ff06b89994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:02.456914 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-35fe01fa-333f-40f1-bea9-b9ff06b89994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:02.457451 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-35fe01fa-333f-40f1-bea9-b9ff06b89994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:02.458599 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-35fe01fa-333f-40f1-bea9-b9ff06b89994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:02.502326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-cdebbe74-b72e-47a7-aebb-9a1ae7d7e4ca tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:02.503656 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-cdebbe74-b72e-47a7-aebb-9a1ae7d7e4ca tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:02.511729 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cdebbe74-b72e-47a7-aebb-9a1ae7d7e4ca tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:02.512229 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cdebbe74-b72e-47a7-aebb-9a1ae7d7e4ca tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:02.512665 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cdebbe74-b72e-47a7-aebb-9a1ae7d7e4ca tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:02.513372 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cdebbe74-b72e-47a7-aebb-9a1ae7d7e4ca tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:02.514009 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cdebbe74-b72e-47a7-aebb-9a1ae7d7e4ca tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:02.514441 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cdebbe74-b72e-47a7-aebb-9a1ae7d7e4ca tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:02.673548 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-35fe01fa-333f-40f1-bea9-b9ff06b89994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:02.684420 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-35fe01fa-333f-40f1-bea9-b9ff06b89994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:02.686536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-35fe01fa-333f-40f1-bea9-b9ff06b89994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:02.688034 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-35fe01fa-333f-40f1-bea9-b9ff06b89994 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1676 microversion: 2.20 time: 0.244124 Oct 03 12:56:02.688687 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 367/736] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:02 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1676 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:56:02.694387 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-9033ef13-e484-4f26-810d-6a64b3d90819 req-05bc92b7-f89c-4b73-8902-f4984b884347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd3132e9-d468-48b0-9ce9-ae78593d7ee0", "name": "network-vif-deleted", "tag": "e5c3ca65-7225-4ec8-a78b-053eba2d46bb"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:56:02.709816 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-9033ef13-e484-4f26-810d-6a64b3d90819 req-05bc92b7-f89c-4b73-8902-f4984b884347 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:02.710314 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-9033ef13-e484-4f26-810d-6a64b3d90819 req-05bc92b7-f89c-4b73-8902-f4984b884347 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:02.710757 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-9033ef13-e484-4f26-810d-6a64b3d90819 req-05bc92b7-f89c-4b73-8902-f4984b884347 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:02.729078 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-9033ef13-e484-4f26-810d-6a64b3d90819 req-05bc92b7-f89c-4b73-8902-f4984b884347 service nova] Creating event network-vif-deleted:e5c3ca65-7225-4ec8-a78b-053eba2d46bb for instance cd3132e9-d468-48b0-9ce9-ae78593d7ee0 on hv-cinder-84456 Oct 03 12:56:02.734369 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-9033ef13-e484-4f26-810d-6a64b3d90819 req-05bc92b7-f89c-4b73-8902-f4984b884347 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044440 Oct 03 12:56:02.735138 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 368/737] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:56:02.751016 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-cdebbe74-b72e-47a7-aebb-9a1ae7d7e4ca tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:02.758094 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-cdebbe74-b72e-47a7-aebb-9a1ae7d7e4ca tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1569 microversion: 2.1 time: 0.259614 Oct 03 12:56:02.759135 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 370/738] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:02 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:02.930355 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-fd2e737d-7fb3-43f9-a412-36708fb13bbd tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:02.930975 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-fd2e737d-7fb3-43f9-a412-36708fb13bbd tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:02.937436 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd2e737d-7fb3-43f9-a412-36708fb13bbd tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:02.942469 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd2e737d-7fb3-43f9-a412-36708fb13bbd tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:02.942469 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd2e737d-7fb3-43f9-a412-36708fb13bbd tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:02.942469 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd2e737d-7fb3-43f9-a412-36708fb13bbd tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:02.942469 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd2e737d-7fb3-43f9-a412-36708fb13bbd tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:02.943022 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd2e737d-7fb3-43f9-a412-36708fb13bbd tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:03.008536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-fd2e737d-7fb3-43f9-a412-36708fb13bbd tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b8ec0638764aba88e1920ecca7ddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead596751f234d79b38d661b0d5c6343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:03.016487 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-fd2e737d-7fb3-43f9-a412-36708fb13bbd tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 200 len: 1299 microversion: 2.1 time: 0.091111 Oct 03 12:56:03.017047 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 369/739] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:02 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:03.718042 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a2a68637-a4c3-4ffd-8678-2c58feefca6c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:03.718676 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a2a68637-a4c3-4ffd-8678-2c58feefca6c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:03.725607 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a2a68637-a4c3-4ffd-8678-2c58feefca6c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:03.726031 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a2a68637-a4c3-4ffd-8678-2c58feefca6c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:03.726463 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a2a68637-a4c3-4ffd-8678-2c58feefca6c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:03.727152 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a2a68637-a4c3-4ffd-8678-2c58feefca6c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:03.727637 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a2a68637-a4c3-4ffd-8678-2c58feefca6c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:03.728066 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a2a68637-a4c3-4ffd-8678-2c58feefca6c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:03.782936 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-851a6996-7d0b-40d6-bc10-ef012ecbd596 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:03.783572 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-851a6996-7d0b-40d6-bc10-ef012ecbd596 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:03.792406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-851a6996-7d0b-40d6-bc10-ef012ecbd596 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:03.792895 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-851a6996-7d0b-40d6-bc10-ef012ecbd596 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:03.793330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-851a6996-7d0b-40d6-bc10-ef012ecbd596 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:03.794031 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-851a6996-7d0b-40d6-bc10-ef012ecbd596 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:03.794496 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-851a6996-7d0b-40d6-bc10-ef012ecbd596 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:03.794918 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-851a6996-7d0b-40d6-bc10-ef012ecbd596 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:03.909869 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-a2a68637-a4c3-4ffd-8678-2c58feefca6c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:03.918966 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-a2a68637-a4c3-4ffd-8678-2c58feefca6c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:03.920483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-a2a68637-a4c3-4ffd-8678-2c58feefca6c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:03.921673 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a2a68637-a4c3-4ffd-8678-2c58feefca6c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1732 microversion: 2.20 time: 0.207491 Oct 03 12:56:03.922578 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 371/740] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:03 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1732 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:56:03.977074 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-851a6996-7d0b-40d6-bc10-ef012ecbd596 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:03.984773 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-851a6996-7d0b-40d6-bc10-ef012ecbd596 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1569 microversion: 2.1 time: 0.205745 Oct 03 12:56:03.985411 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 370/741] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:03 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:04.040794 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0bb64a5d-feb3-4830-a21f-a49a2cb5d315 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:04.041410 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-0bb64a5d-feb3-4830-a21f-a49a2cb5d315 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:04.051637 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0bb64a5d-feb3-4830-a21f-a49a2cb5d315 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:04.051637 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0bb64a5d-feb3-4830-a21f-a49a2cb5d315 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:04.051637 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0bb64a5d-feb3-4830-a21f-a49a2cb5d315 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:04.051637 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0bb64a5d-feb3-4830-a21f-a49a2cb5d315 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:04.052118 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0bb64a5d-feb3-4830-a21f-a49a2cb5d315 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:04.052118 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0bb64a5d-feb3-4830-a21f-a49a2cb5d315 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:04.055835 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f746afbe-09e5-4929-92a6-ad74a8ab3a0c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:04.057929 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f746afbe-09e5-4929-92a6-ad74a8ab3a0c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:04.064658 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f746afbe-09e5-4929-92a6-ad74a8ab3a0c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:04.065432 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f746afbe-09e5-4929-92a6-ad74a8ab3a0c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:04.065959 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f746afbe-09e5-4929-92a6-ad74a8ab3a0c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:04.066816 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f746afbe-09e5-4929-92a6-ad74a8ab3a0c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:04.067564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f746afbe-09e5-4929-92a6-ad74a8ab3a0c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:04.068214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f746afbe-09e5-4929-92a6-ad74a8ab3a0c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:04.083288 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-f746afbe-09e5-4929-92a6-ad74a8ab3a0c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] HTTP exception thrown: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f746afbe-09e5-4929-92a6-ad74a8ab3a0c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Request method failure captured: Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: DELETE /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 HTTP/1.1 Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtpqveAWd5CfrsBJwJ-Bq-Llx8KmrbMxOIBesMnErADsus0b_wqY-2tmcSYAAz2WfEJ7g-jJZEnFBk9mJ4D5lxpIvp8Y1RcIXWQiqIZkavte4X7fbzVp0l8551bmo8lX1QJOgKeKQkz1VzGt6VpqDhc35pWwkzdfdezYsA_Ijwfe7OQ Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: cc40d256f0e24050b6b53fdbcbce1962 Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:56:04.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:56:04.086994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:56:04.086994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:56:04.086994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: cc40d256f0e24050b6b53fdbcbce1962 Oct 03 12:56:04.086994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:56:04.086994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-AttachVolumeTestJSON-1115138470-project Oct 03 12:56:04.086994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:56:04.086994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:56:04.086994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: bd24d209dc9644e8b2860a0e676acd3b Oct 03 12:56:04.086994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-AttachVolumeTestJSON-1115138470-project Oct 03 12:56:04.086994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:56:04.086994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. Oct 03 12:56:04.086994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': '03a5c967-4163-4841-ae8c-77d508c0ff59'} Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:56:04.091003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. Oct 03 12:56:04.092379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:04.093837 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f746afbe-09e5-4929-92a6-ad74a8ab3a0c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Returning 404 to user: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:56:04.093837 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f746afbe-09e5-4929-92a6-ad74a8ab3a0c tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 404 len: 111 microversion: 2.1 time: 0.038325 Oct 03 12:56:04.093837 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 371/742] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:56:04 2022] DELETE /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:56:04.094335 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0bb64a5d-feb3-4830-a21f-a49a2cb5d315 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:04.094833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0bb64a5d-feb3-4830-a21f-a49a2cb5d315 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:04.095344 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0bb64a5d-feb3-4830-a21f-a49a2cb5d315 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:04.095972 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-0bb64a5d-feb3-4830-a21f-a49a2cb5d315 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lazy-loading 'fault' on Instance uuid cd3132e9-d468-48b0-9ce9-ae78593d7ee0 {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:56:04.100362 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-471a21ef-8616-4915-bb06-80cd4113910a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:04.100991 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-471a21ef-8616-4915-bb06-80cd4113910a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: 03a5c967-4163-4841-ae8c-77d508c0ff59] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:04.107409 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-471a21ef-8616-4915-bb06-80cd4113910a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:04.107891 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-471a21ef-8616-4915-bb06-80cd4113910a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:04.108379 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-471a21ef-8616-4915-bb06-80cd4113910a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:04.109236 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-471a21ef-8616-4915-bb06-80cd4113910a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:04.109701 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-471a21ef-8616-4915-bb06-80cd4113910a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:04.110413 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-471a21ef-8616-4915-bb06-80cd4113910a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:04.125051 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-471a21ef-8616-4915-bb06-80cd4113910a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] HTTP exception thrown: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-471a21ef-8616-4915-bb06-80cd4113910a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Request method failure captured: Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 HTTP/1.1 Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtpqveAWd5CfrsBJwJ-Bq-Llx8KmrbMxOIBesMnErADsus0b_wqY-2tmcSYAAz2WfEJ7g-jJZEnFBk9mJ4D5lxpIvp8Y1RcIXWQiqIZkavte4X7fbzVp0l8551bmo8lX1QJOgKeKQkz1VzGt6VpqDhc35pWwkzdfdezYsA_Ijwfe7OQ Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: cc40d256f0e24050b6b53fdbcbce1962 Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:56:04.126594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:56:04.127921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:56:04.127921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:56:04.127921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: cc40d256f0e24050b6b53fdbcbce1962 Oct 03 12:56:04.127921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:56:04.127921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-AttachVolumeTestJSON-1115138470-project Oct 03 12:56:04.127921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:56:04.127921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:56:04.127921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: bd24d209dc9644e8b2860a0e676acd3b Oct 03 12:56:04.127921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-AttachVolumeTestJSON-1115138470-project Oct 03 12:56:04.127921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:56:04.127921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. Oct 03 12:56:04.127921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': '03a5c967-4163-4841-ae8c-77d508c0ff59'} Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:56:04.128685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. Oct 03 12:56:04.131214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:04.132626 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-471a21ef-8616-4915-bb06-80cd4113910a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Returning 404 to user: Instance 03a5c967-4163-4841-ae8c-77d508c0ff59 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:56:04.132626 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-471a21ef-8616-4915-bb06-80cd4113910a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59" status: 404 len: 111 microversion: 2.1 time: 0.032590 Oct 03 12:56:04.132626 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 372/743] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:04 2022] GET /compute/v2.1/servers/03a5c967-4163-4841-ae8c-77d508c0ff59 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:56:04.145909 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0bb64a5d-feb3-4830-a21f-a49a2cb5d315 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b8ec0638764aba88e1920ecca7ddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead596751f234d79b38d661b0d5c6343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:04.153460 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0bb64a5d-feb3-4830-a21f-a49a2cb5d315 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 200 len: 1304 microversion: 2.1 time: 0.117537 Oct 03 12:56:04.154233 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 372/744] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:04 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:04.947899 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-6b0ac625-6357-4f46-9744-d02e8c307727 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:04.948499 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-6b0ac625-6357-4f46-9744-d02e8c307727 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:04.957631 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b0ac625-6357-4f46-9744-d02e8c307727 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:04.959170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b0ac625-6357-4f46-9744-d02e8c307727 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:04.960016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b0ac625-6357-4f46-9744-d02e8c307727 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:04.961066 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b0ac625-6357-4f46-9744-d02e8c307727 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:04.961597 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b0ac625-6357-4f46-9744-d02e8c307727 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:04.962267 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6b0ac625-6357-4f46-9744-d02e8c307727 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:05.009657 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-4b9ceff7-c593-4e53-a8ba-1c19c1181b43 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:05.011087 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-4b9ceff7-c593-4e53-a8ba-1c19c1181b43 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:05.022724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4b9ceff7-c593-4e53-a8ba-1c19c1181b43 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:05.023972 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4b9ceff7-c593-4e53-a8ba-1c19c1181b43 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:05.024970 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4b9ceff7-c593-4e53-a8ba-1c19c1181b43 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:05.025864 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4b9ceff7-c593-4e53-a8ba-1c19c1181b43 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:05.026343 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4b9ceff7-c593-4e53-a8ba-1c19c1181b43 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:05.027427 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4b9ceff7-c593-4e53-a8ba-1c19c1181b43 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:05.212850 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6b0ac625-6357-4f46-9744-d02e8c307727 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:05.222007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6b0ac625-6357-4f46-9744-d02e8c307727 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:05.224707 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6b0ac625-6357-4f46-9744-d02e8c307727 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:05.226055 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-6b0ac625-6357-4f46-9744-d02e8c307727 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1732 microversion: 2.20 time: 0.282167 Oct 03 12:56:05.227131 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 373/745] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:04 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1732 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:56:05.231880 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8c5ef591-3957-420d-85ae-6dfb749d9714 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:05.233524 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8c5ef591-3957-420d-85ae-6dfb749d9714 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] [instance: cd3132e9-d468-48b0-9ce9-ae78593d7ee0] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:05.245408 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c5ef591-3957-420d-85ae-6dfb749d9714 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:05.246292 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c5ef591-3957-420d-85ae-6dfb749d9714 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:05.246832 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c5ef591-3957-420d-85ae-6dfb749d9714 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:05.248015 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c5ef591-3957-420d-85ae-6dfb749d9714 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:05.248754 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c5ef591-3957-420d-85ae-6dfb749d9714 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:05.255564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8c5ef591-3957-420d-85ae-6dfb749d9714 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:05.262356 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4b9ceff7-c593-4e53-a8ba-1c19c1181b43 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:05.270821 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-4b9ceff7-c593-4e53-a8ba-1c19c1181b43 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1569 microversion: 2.1 time: 0.266010 Oct 03 12:56:05.275159 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-8c5ef591-3957-420d-85ae-6dfb749d9714 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] HTTP exception thrown: Instance cd3132e9-d468-48b0-9ce9-ae78593d7ee0 could not be found. Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8c5ef591-3957-420d-85ae-6dfb749d9714 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Request method failure captured: Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 HTTP/1.1 Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtvNvg1dQQHVjYbNvZPTb6HmzN81GRtkghPAhL9hctLxQsv8kBskT9alQbuRT-tQaVtXJ_MS4NYptqI21XsCOg4ojC0r1GxEssSl5K6bA-TREiHt-ddqu921AiXFDztSwwfy9VFtfQ2nDXv8PwNi9A5O3tCPrQ3mBdJXdW7jNSNV3zs Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: ead596751f234d79b38d661b0d5c6343 Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-VolumesNegativeTest-1528148254 Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:56:05.276920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:56:05.285879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ead596751f234d79b38d661b0d5c6343"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ead596751f234d79b38d661b0d5c6343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ead596751f234d79b38d661b0d5c6343"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ead596751f234d79b38d661b0d5c6343"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:56:05.285879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-VolumesNegativeTest-1528148254 Oct 03 12:56:05.285879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: ead596751f234d79b38d661b0d5c6343 Oct 03 12:56:05.285879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-VolumesNegativeTest-1528148254 Oct 03 12:56:05.285879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-VolumesNegativeTest-1528148254-project Oct 03 12:56:05.285879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:56:05.285879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:56:05.285879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: d3b8ec0638764aba88e1920ecca7ddbc Oct 03 12:56:05.285879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-VolumesNegativeTest-1528148254-project Oct 03 12:56:05.285879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:56:05.285879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance cd3132e9-d468-48b0-9ce9-ae78593d7ee0 could not be found. Oct 03 12:56:05.285879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': 'cd3132e9-d468-48b0-9ce9-ae78593d7ee0'} Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd3132e9-d468-48b0-9ce9-ae78593d7ee0 could not be found. Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:56:05.286649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd3132e9-d468-48b0-9ce9-ae78593d7ee0 could not be found. Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd3132e9-d468-48b0-9ce9-ae78593d7ee0 could not be found. Oct 03 12:56:05.288449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:05.289803 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8c5ef591-3957-420d-85ae-6dfb749d9714 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] Returning 404 to user: Instance cd3132e9-d468-48b0-9ce9-ae78593d7ee0 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:56:05.289803 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8c5ef591-3957-420d-85ae-6dfb749d9714 tempest-VolumesNegativeTest-1528148254 tempest-VolumesNegativeTest-1528148254-project] 10.222.0.33 "GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0" status: 404 len: 111 microversion: 2.1 time: 0.050000 Oct 03 12:56:05.289803 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 374/746] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:05 2022] GET /compute/v2.1/servers/cd3132e9-d468-48b0-9ce9-ae78593d7ee0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:56:05.290181 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 373/747] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:05 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1569 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:05.547422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1b015ec1-c865-4ad9-a99c-8215881c49d7 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:05.547920 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-1b015ec1-c865-4ad9-a99c-8215881c49d7 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:05.554766 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b015ec1-c865-4ad9-a99c-8215881c49d7 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:05.561202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b015ec1-c865-4ad9-a99c-8215881c49d7 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:05.561202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b015ec1-c865-4ad9-a99c-8215881c49d7 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:05.561202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b015ec1-c865-4ad9-a99c-8215881c49d7 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:05.561202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b015ec1-c865-4ad9-a99c-8215881c49d7 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:05.561560 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b015ec1-c865-4ad9-a99c-8215881c49d7 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:05.572667 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-1b015ec1-c865-4ad9-a99c-8215881c49d7 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] HTTP exception thrown: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1b015ec1-c865-4ad9-a99c-8215881c49d7 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Request method failure captured: Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: DELETE /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed HTTP/1.1 Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtpqveAWd5CfrsBJwJ-Bq-Llx8KmrbMxOIBesMnErADsus0b_wqY-2tmcSYAAz2WfEJ7g-jJZEnFBk9mJ4D5lxpIvp8Y1RcIXWQiqIZkavte4X7fbzVp0l8551bmo8lX1QJOgKeKQkz1VzGt6VpqDhc35pWwkzdfdezYsA_Ijwfe7OQ Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: cc40d256f0e24050b6b53fdbcbce1962 Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:56:05.574546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:56:05.581117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:56:05.581117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:56:05.581117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: cc40d256f0e24050b6b53fdbcbce1962 Oct 03 12:56:05.581117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:56:05.581117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-AttachVolumeTestJSON-1115138470-project Oct 03 12:56:05.581117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:56:05.581117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:56:05.581117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: bd24d209dc9644e8b2860a0e676acd3b Oct 03 12:56:05.581117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-AttachVolumeTestJSON-1115138470-project Oct 03 12:56:05.581117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:56:05.581117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. Oct 03 12:56:05.581117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': 'a980d091-a942-46bc-a139-d12f9e2167ed'} Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:56:05.582007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. Oct 03 12:56:05.583363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:56:05.584802 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1b015ec1-c865-4ad9-a99c-8215881c49d7 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Returning 404 to user: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:56:05.584802 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-1b015ec1-c865-4ad9-a99c-8215881c49d7 tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 404 len: 111 microversion: 2.1 time: 0.033429 Oct 03 12:56:05.584802 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 375/748] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:56:05 2022] DELETE /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:56:05.588356 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-f831a0bc-1a95-4e62-b5be-817329b6b12a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:05.589079 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-f831a0bc-1a95-4e62-b5be-817329b6b12a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] [instance: a980d091-a942-46bc-a139-d12f9e2167ed] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:05.595170 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f831a0bc-1a95-4e62-b5be-817329b6b12a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:05.595820 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f831a0bc-1a95-4e62-b5be-817329b6b12a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:05.596371 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f831a0bc-1a95-4e62-b5be-817329b6b12a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:05.597252 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f831a0bc-1a95-4e62-b5be-817329b6b12a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:05.597817 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f831a0bc-1a95-4e62-b5be-817329b6b12a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:05.598872 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f831a0bc-1a95-4e62-b5be-817329b6b12a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:05.613387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-f831a0bc-1a95-4e62-b5be-817329b6b12a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] HTTP exception thrown: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-f831a0bc-1a95-4e62-b5be-817329b6b12a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Request method failure captured: Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed HTTP/1.1 Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtpqveAWd5CfrsBJwJ-Bq-Llx8KmrbMxOIBesMnErADsus0b_wqY-2tmcSYAAz2WfEJ7g-jJZEnFBk9mJ4D5lxpIvp8Y1RcIXWQiqIZkavte4X7fbzVp0l8551bmo8lX1QJOgKeKQkz1VzGt6VpqDhc35pWwkzdfdezYsA_Ijwfe7OQ Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: cc40d256f0e24050b6b53fdbcbce1962 Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 12:56:05.615503 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 12:56:05.617122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc40d256f0e24050b6b53fdbcbce1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:56:05.617122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:56:05.617122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: cc40d256f0e24050b6b53fdbcbce1962 Oct 03 12:56:05.617122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1115138470 Oct 03 12:56:05.617122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-AttachVolumeTestJSON-1115138470-project Oct 03 12:56:05.617122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 12:56:05.617122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 12:56:05.617122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: bd24d209dc9644e8b2860a0e676acd3b Oct 03 12:56:05.617122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-AttachVolumeTestJSON-1115138470-project Oct 03 12:56:05.617122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 12:56:05.617122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. Oct 03 12:56:05.617122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': 'a980d091-a942-46bc-a139-d12f9e2167ed'} Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:56:05.617842 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. Oct 03 12:56:05.619483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:56:05.620924 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-f831a0bc-1a95-4e62-b5be-817329b6b12a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] Returning 404 to user: Instance a980d091-a942-46bc-a139-d12f9e2167ed could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:56:05.620924 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-f831a0bc-1a95-4e62-b5be-817329b6b12a tempest-AttachVolumeTestJSON-1115138470 tempest-AttachVolumeTestJSON-1115138470-project] 10.222.0.33 "GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed" status: 404 len: 111 microversion: 2.1 time: 0.035572 Oct 03 12:56:05.620924 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 374/749] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:05 2022] GET /compute/v2.1/servers/a980d091-a942-46bc-a139-d12f9e2167ed => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:56:06.254805 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-37ddc176-3c1c-4b56-aeba-5b7f4fed27b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:06.259548 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-37ddc176-3c1c-4b56-aeba-5b7f4fed27b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:06.269881 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37ddc176-3c1c-4b56-aeba-5b7f4fed27b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:06.270413 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37ddc176-3c1c-4b56-aeba-5b7f4fed27b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:06.270930 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37ddc176-3c1c-4b56-aeba-5b7f4fed27b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:06.271737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37ddc176-3c1c-4b56-aeba-5b7f4fed27b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:06.272269 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37ddc176-3c1c-4b56-aeba-5b7f4fed27b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:06.272871 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37ddc176-3c1c-4b56-aeba-5b7f4fed27b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:06.294628 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-4f7a0200-79f1-450a-8ef2-1fbac9ab81ce tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:06.295910 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-4f7a0200-79f1-450a-8ef2-1fbac9ab81ce tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:06.296783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:56:06.312477 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f7a0200-79f1-450a-8ef2-1fbac9ab81ce tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:06.313306 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f7a0200-79f1-450a-8ef2-1fbac9ab81ce tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:06.313940 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f7a0200-79f1-450a-8ef2-1fbac9ab81ce tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:06.314864 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f7a0200-79f1-450a-8ef2-1fbac9ab81ce tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:06.319970 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f7a0200-79f1-450a-8ef2-1fbac9ab81ce tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:06.321481 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f7a0200-79f1-450a-8ef2-1fbac9ab81ce tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:06.606544 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-37ddc176-3c1c-4b56-aeba-5b7f4fed27b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:06.625237 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-37ddc176-3c1c-4b56-aeba-5b7f4fed27b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:06.626699 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-37ddc176-3c1c-4b56-aeba-5b7f4fed27b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:06.627927 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-37ddc176-3c1c-4b56-aeba-5b7f4fed27b0 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1732 microversion: 2.20 time: 0.378020 Oct 03 12:56:06.630672 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 376/750] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:06 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1732 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:56:06.687392 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4f7a0200-79f1-450a-8ef2-1fbac9ab81ce tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:06.724720 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-4f7a0200-79f1-450a-8ef2-1fbac9ab81ce tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1569 microversion: 2.1 time: 0.433781 Oct 03 12:56:06.739706 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 375/751] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:06 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1569 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:07.663833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3390a154-c482-4f6b-85f9-8ec9ce3febd4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:07.665196 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3390a154-c482-4f6b-85f9-8ec9ce3febd4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:07.675871 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3390a154-c482-4f6b-85f9-8ec9ce3febd4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:07.688843 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3390a154-c482-4f6b-85f9-8ec9ce3febd4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:07.690286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3390a154-c482-4f6b-85f9-8ec9ce3febd4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:07.691678 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3390a154-c482-4f6b-85f9-8ec9ce3febd4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:07.692320 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3390a154-c482-4f6b-85f9-8ec9ce3febd4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:07.692905 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3390a154-c482-4f6b-85f9-8ec9ce3febd4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:07.751884 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3059b967-f1c5-4161-ab19-ec8ab6e4f8da tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:07.753826 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-3059b967-f1c5-4161-ab19-ec8ab6e4f8da tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:07.763590 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3059b967-f1c5-4161-ab19-ec8ab6e4f8da tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:07.764345 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3059b967-f1c5-4161-ab19-ec8ab6e4f8da tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:07.765111 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3059b967-f1c5-4161-ab19-ec8ab6e4f8da tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:07.766108 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3059b967-f1c5-4161-ab19-ec8ab6e4f8da tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:07.766799 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3059b967-f1c5-4161-ab19-ec8ab6e4f8da tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:07.767403 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3059b967-f1c5-4161-ab19-ec8ab6e4f8da tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:08.117694 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3390a154-c482-4f6b-85f9-8ec9ce3febd4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:08.135192 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3390a154-c482-4f6b-85f9-8ec9ce3febd4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:08.136953 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3390a154-c482-4f6b-85f9-8ec9ce3febd4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:08.138336 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3390a154-c482-4f6b-85f9-8ec9ce3febd4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1732 microversion: 2.20 time: 0.482961 Oct 03 12:56:08.155975 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 377/752] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:07 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1732 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:56:08.161577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3059b967-f1c5-4161-ab19-ec8ab6e4f8da tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:08.171877 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-3059b967-f1c5-4161-ab19-ec8ab6e4f8da tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1569 microversion: 2.1 time: 0.424030 Oct 03 12:56:08.173023 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 376/753] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:07 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1569 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:09.171619 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-37a795e0-d3dd-4fee-abad-103df287b5de tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:09.171619 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-37a795e0-d3dd-4fee-abad-103df287b5de tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:09.179182 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37a795e0-d3dd-4fee-abad-103df287b5de tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:09.180180 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37a795e0-d3dd-4fee-abad-103df287b5de tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:09.181344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37a795e0-d3dd-4fee-abad-103df287b5de tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:09.182631 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37a795e0-d3dd-4fee-abad-103df287b5de tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:09.183858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37a795e0-d3dd-4fee-abad-103df287b5de tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:09.184232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-37a795e0-d3dd-4fee-abad-103df287b5de tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:09.196383 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-507755ed-f879-4697-b853-596bef10bb9a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:09.205696 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-507755ed-f879-4697-b853-596bef10bb9a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:09.218580 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-507755ed-f879-4697-b853-596bef10bb9a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:09.221349 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-507755ed-f879-4697-b853-596bef10bb9a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:09.222003 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-507755ed-f879-4697-b853-596bef10bb9a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:09.222753 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-507755ed-f879-4697-b853-596bef10bb9a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:09.225364 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-507755ed-f879-4697-b853-596bef10bb9a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:09.225844 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-507755ed-f879-4697-b853-596bef10bb9a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:09.567303 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-37a795e0-d3dd-4fee-abad-103df287b5de tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:09.580502 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-37a795e0-d3dd-4fee-abad-103df287b5de tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:09.581985 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-37a795e0-d3dd-4fee-abad-103df287b5de tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:09.586559 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-37a795e0-d3dd-4fee-abad-103df287b5de tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1732 microversion: 2.20 time: 0.421180 Oct 03 12:56:09.587149 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 378/754] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:09 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1732 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:56:09.588301 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-507755ed-f879-4697-b853-596bef10bb9a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:09.596651 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-507755ed-f879-4697-b853-596bef10bb9a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1569 microversion: 2.1 time: 0.404144 Oct 03 12:56:09.617910 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 377/755] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:09 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1569 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:10.615123 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8a55a393-8b05-4cbf-9733-3464dd036424 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:10.615743 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8a55a393-8b05-4cbf-9733-3464dd036424 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:10.627758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d8d52e4e-90eb-424f-bfaf-4c729c2c443c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:10.629538 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d8d52e4e-90eb-424f-bfaf-4c729c2c443c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:10.636530 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8a55a393-8b05-4cbf-9733-3464dd036424 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:10.639047 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d8d52e4e-90eb-424f-bfaf-4c729c2c443c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:10.639829 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8a55a393-8b05-4cbf-9733-3464dd036424 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:10.640511 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8a55a393-8b05-4cbf-9733-3464dd036424 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:10.641481 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8a55a393-8b05-4cbf-9733-3464dd036424 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:10.642212 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d8d52e4e-90eb-424f-bfaf-4c729c2c443c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:10.642961 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8a55a393-8b05-4cbf-9733-3464dd036424 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:10.643581 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d8d52e4e-90eb-424f-bfaf-4c729c2c443c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:10.644053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8a55a393-8b05-4cbf-9733-3464dd036424 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:10.645720 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d8d52e4e-90eb-424f-bfaf-4c729c2c443c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:10.650626 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d8d52e4e-90eb-424f-bfaf-4c729c2c443c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:10.651292 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d8d52e4e-90eb-424f-bfaf-4c729c2c443c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:11.051847 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d8d52e4e-90eb-424f-bfaf-4c729c2c443c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:11.062441 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d8d52e4e-90eb-424f-bfaf-4c729c2c443c tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1569 microversion: 2.1 time: 0.438181 Oct 03 12:56:11.064763 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 378/756] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:10 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1569 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:11.091956 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8a55a393-8b05-4cbf-9733-3464dd036424 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:11.107799 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8a55a393-8b05-4cbf-9733-3464dd036424 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:11.109360 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8a55a393-8b05-4cbf-9733-3464dd036424 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:11.113258 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8a55a393-8b05-4cbf-9733-3464dd036424 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1732 microversion: 2.20 time: 0.502777 Oct 03 12:56:11.120002 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 379/757] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:10 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1732 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:56:12.088029 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-36324dca-2034-4be0-b69b-855d5ee554b0 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:12.088905 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-36324dca-2034-4be0-b69b-855d5ee554b0 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:12.096083 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36324dca-2034-4be0-b69b-855d5ee554b0 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:12.096742 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36324dca-2034-4be0-b69b-855d5ee554b0 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:12.097329 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36324dca-2034-4be0-b69b-855d5ee554b0 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:12.098895 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36324dca-2034-4be0-b69b-855d5ee554b0 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:12.099381 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36324dca-2034-4be0-b69b-855d5ee554b0 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:12.099813 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-36324dca-2034-4be0-b69b-855d5ee554b0 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:12.115778 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:56:12.146028 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-6e46e044-97c6-462d-83cd-7213235233bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:12.148370 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-6e46e044-97c6-462d-83cd-7213235233bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:12.155475 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6e46e044-97c6-462d-83cd-7213235233bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:12.156075 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6e46e044-97c6-462d-83cd-7213235233bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:12.156671 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6e46e044-97c6-462d-83cd-7213235233bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:12.157469 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6e46e044-97c6-462d-83cd-7213235233bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:12.158008 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6e46e044-97c6-462d-83cd-7213235233bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:12.158556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6e46e044-97c6-462d-83cd-7213235233bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:12.319401 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-36324dca-2034-4be0-b69b-855d5ee554b0 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:12.328240 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-36324dca-2034-4be0-b69b-855d5ee554b0 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1569 microversion: 2.1 time: 0.244697 Oct 03 12:56:12.328809 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 379/758] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:12 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:12.344551 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6e46e044-97c6-462d-83cd-7213235233bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:12.353790 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6e46e044-97c6-462d-83cd-7213235233bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:12.355396 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6e46e044-97c6-462d-83cd-7213235233bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:12.356568 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-6e46e044-97c6-462d-83cd-7213235233bc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1732 microversion: 2.20 time: 0.215116 Oct 03 12:56:12.357116 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 380/759] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:12 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1732 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:56:13.353462 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-6c3374a0-6e53-4b28-9d5b-b359b2e00a16 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:13.354115 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-6c3374a0-6e53-4b28-9d5b-b359b2e00a16 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:13.360900 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6c3374a0-6e53-4b28-9d5b-b359b2e00a16 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:13.361392 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6c3374a0-6e53-4b28-9d5b-b359b2e00a16 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:13.361906 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6c3374a0-6e53-4b28-9d5b-b359b2e00a16 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:13.363050 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6c3374a0-6e53-4b28-9d5b-b359b2e00a16 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:13.363170 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6c3374a0-6e53-4b28-9d5b-b359b2e00a16 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:13.364709 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6c3374a0-6e53-4b28-9d5b-b359b2e00a16 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:13.417936 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-eca3c56b-590b-4cce-b711-b14101b963e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:13.418799 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-eca3c56b-590b-4cce-b711-b14101b963e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:13.425317 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-eca3c56b-590b-4cce-b711-b14101b963e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:13.426461 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-eca3c56b-590b-4cce-b711-b14101b963e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:13.426974 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-eca3c56b-590b-4cce-b711-b14101b963e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:13.427740 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-eca3c56b-590b-4cce-b711-b14101b963e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:13.428199 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-eca3c56b-590b-4cce-b711-b14101b963e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:13.428652 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-eca3c56b-590b-4cce-b711-b14101b963e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:13.548077 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-6c3374a0-6e53-4b28-9d5b-b359b2e00a16 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:13.556466 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-6c3374a0-6e53-4b28-9d5b-b359b2e00a16 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1569 microversion: 2.1 time: 0.208368 Oct 03 12:56:13.557050 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 380/760] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:13 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:13.595409 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-eca3c56b-590b-4cce-b711-b14101b963e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:13.604302 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-eca3c56b-590b-4cce-b711-b14101b963e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:13.605800 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-eca3c56b-590b-4cce-b711-b14101b963e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:13.606992 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-eca3c56b-590b-4cce-b711-b14101b963e4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1732 microversion: 2.20 time: 0.193019 Oct 03 12:56:13.607538 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 381/761] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:13 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:56:14.581300 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-26a1b924-613c-4109-b56c-f53cfa4f1978 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:14.582072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-26a1b924-613c-4109-b56c-f53cfa4f1978 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:14.588991 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-26a1b924-613c-4109-b56c-f53cfa4f1978 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:14.589602 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-26a1b924-613c-4109-b56c-f53cfa4f1978 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:14.590288 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-26a1b924-613c-4109-b56c-f53cfa4f1978 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:14.591091 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-26a1b924-613c-4109-b56c-f53cfa4f1978 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:14.591826 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-26a1b924-613c-4109-b56c-f53cfa4f1978 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:14.592319 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-26a1b924-613c-4109-b56c-f53cfa4f1978 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:14.633497 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4b850089-262a-40d1-80bf-c290c09da4c4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:14.634372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-4b850089-262a-40d1-80bf-c290c09da4c4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:14.641553 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b850089-262a-40d1-80bf-c290c09da4c4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:14.642435 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b850089-262a-40d1-80bf-c290c09da4c4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:14.642883 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b850089-262a-40d1-80bf-c290c09da4c4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:14.643619 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b850089-262a-40d1-80bf-c290c09da4c4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:14.644075 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b850089-262a-40d1-80bf-c290c09da4c4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:14.644554 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b850089-262a-40d1-80bf-c290c09da4c4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:14.871001 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-26a1b924-613c-4109-b56c-f53cfa4f1978 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:14.880739 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-26a1b924-613c-4109-b56c-f53cfa4f1978 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1569 microversion: 2.1 time: 0.304397 Oct 03 12:56:14.881703 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 381/762] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:14 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1569 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:14.917822 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4b850089-262a-40d1-80bf-c290c09da4c4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:14.929064 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4b850089-262a-40d1-80bf-c290c09da4c4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:14.930737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4b850089-262a-40d1-80bf-c290c09da4c4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:14.932101 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-4b850089-262a-40d1-80bf-c290c09da4c4 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1732 microversion: 2.20 time: 0.303289 Oct 03 12:56:14.932816 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 382/763] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:14 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1732 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:56:15.904448 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9bd82648-c38d-43d1-9aeb-db0ac9260abb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:15.905088 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-9bd82648-c38d-43d1-9aeb-db0ac9260abb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:15.911262 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9bd82648-c38d-43d1-9aeb-db0ac9260abb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:15.914647 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9bd82648-c38d-43d1-9aeb-db0ac9260abb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:15.914647 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9bd82648-c38d-43d1-9aeb-db0ac9260abb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:15.914647 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9bd82648-c38d-43d1-9aeb-db0ac9260abb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:15.914647 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9bd82648-c38d-43d1-9aeb-db0ac9260abb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:15.915063 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9bd82648-c38d-43d1-9aeb-db0ac9260abb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:15.957258 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3fa10a19-aad1-4945-852d-96e9a6f95b41 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:15.958698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3fa10a19-aad1-4945-852d-96e9a6f95b41 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:15.965414 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3fa10a19-aad1-4945-852d-96e9a6f95b41 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:15.967362 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3fa10a19-aad1-4945-852d-96e9a6f95b41 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:15.967362 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3fa10a19-aad1-4945-852d-96e9a6f95b41 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:15.967362 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3fa10a19-aad1-4945-852d-96e9a6f95b41 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:15.967663 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3fa10a19-aad1-4945-852d-96e9a6f95b41 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:15.969074 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3fa10a19-aad1-4945-852d-96e9a6f95b41 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:16.104913 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9bd82648-c38d-43d1-9aeb-db0ac9260abb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:16.114195 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-9bd82648-c38d-43d1-9aeb-db0ac9260abb tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1569 microversion: 2.1 time: 0.213028 Oct 03 12:56:16.124347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 382/764] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:15 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:16.153267 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3fa10a19-aad1-4945-852d-96e9a6f95b41 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:16.162270 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3fa10a19-aad1-4945-852d-96e9a6f95b41 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:16.163745 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3fa10a19-aad1-4945-852d-96e9a6f95b41 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:16.165042 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3fa10a19-aad1-4945-852d-96e9a6f95b41 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1732 microversion: 2.20 time: 0.211962 Oct 03 12:56:16.165618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 383/765] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:15 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1732 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:56:17.138271 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-6dcb0c4b-44f9-46eb-a0db-56727f4ab379 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:17.138990 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-6dcb0c4b-44f9-46eb-a0db-56727f4ab379 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:17.141583 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:56:17.149849 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6dcb0c4b-44f9-46eb-a0db-56727f4ab379 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:17.150368 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6dcb0c4b-44f9-46eb-a0db-56727f4ab379 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:17.151015 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6dcb0c4b-44f9-46eb-a0db-56727f4ab379 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:17.152018 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6dcb0c4b-44f9-46eb-a0db-56727f4ab379 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:17.152725 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6dcb0c4b-44f9-46eb-a0db-56727f4ab379 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:17.153364 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6dcb0c4b-44f9-46eb-a0db-56727f4ab379 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:17.192065 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-44dff0e3-2f3d-4c96-9ed4-19d7dab6d929 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:17.192681 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-44dff0e3-2f3d-4c96-9ed4-19d7dab6d929 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:17.198858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:56:17.219004 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44dff0e3-2f3d-4c96-9ed4-19d7dab6d929 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:17.219611 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44dff0e3-2f3d-4c96-9ed4-19d7dab6d929 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:17.221542 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44dff0e3-2f3d-4c96-9ed4-19d7dab6d929 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:17.227229 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44dff0e3-2f3d-4c96-9ed4-19d7dab6d929 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:17.227976 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44dff0e3-2f3d-4c96-9ed4-19d7dab6d929 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:17.228536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44dff0e3-2f3d-4c96-9ed4-19d7dab6d929 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:17.369969 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-6dcb0c4b-44f9-46eb-a0db-56727f4ab379 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:17.377934 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-6dcb0c4b-44f9-46eb-a0db-56727f4ab379 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1569 microversion: 2.1 time: 0.243822 Oct 03 12:56:17.395332 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 383/766] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:17 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1569 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:17.435659 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-44dff0e3-2f3d-4c96-9ed4-19d7dab6d929 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:17.445419 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-44dff0e3-2f3d-4c96-9ed4-19d7dab6d929 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:17.447012 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-44dff0e3-2f3d-4c96-9ed4-19d7dab6d929 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:17.448285 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-44dff0e3-2f3d-4c96-9ed4-19d7dab6d929 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1732 microversion: 2.20 time: 0.260974 Oct 03 12:56:17.449162 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 384/767] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:17 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1732 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:56:17.694914 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-dbf86ffc-d14b-4043-929b-ac8902584e60 req-f2bcaafb-ce13-485d-8052-749bcdb3803f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b37dd24-5a6e-4898-8247-8e00786088ea", "name": "network-vif-plugged", "status": "completed", "tag": "778fd61a-2cb6-43b5-ad14-c9a69f32bf7c"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:56:17.706074 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-dbf86ffc-d14b-4043-929b-ac8902584e60 req-f2bcaafb-ce13-485d-8052-749bcdb3803f service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:17.706567 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-dbf86ffc-d14b-4043-929b-ac8902584e60 req-f2bcaafb-ce13-485d-8052-749bcdb3803f service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:17.707115 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-dbf86ffc-d14b-4043-929b-ac8902584e60 req-f2bcaafb-ce13-485d-8052-749bcdb3803f service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:17.724292 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-dbf86ffc-d14b-4043-929b-ac8902584e60 req-f2bcaafb-ce13-485d-8052-749bcdb3803f service nova] Creating event network-vif-plugged:778fd61a-2cb6-43b5-ad14-c9a69f32bf7c for instance 6b37dd24-5a6e-4898-8247-8e00786088ea on hv-cinder-84456 Oct 03 12:56:17.730270 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-dbf86ffc-d14b-4043-929b-ac8902584e60 req-f2bcaafb-ce13-485d-8052-749bcdb3803f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041589 Oct 03 12:56:17.731177 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 384/768] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:56:18.404463 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-5132a9a6-3ab9-44e1-8b8d-e66b7d7d76b3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:18.405101 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-5132a9a6-3ab9-44e1-8b8d-e66b7d7d76b3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:18.421331 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5132a9a6-3ab9-44e1-8b8d-e66b7d7d76b3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:18.423182 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5132a9a6-3ab9-44e1-8b8d-e66b7d7d76b3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:18.423832 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5132a9a6-3ab9-44e1-8b8d-e66b7d7d76b3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:18.424835 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5132a9a6-3ab9-44e1-8b8d-e66b7d7d76b3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:18.425463 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5132a9a6-3ab9-44e1-8b8d-e66b7d7d76b3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:18.432402 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5132a9a6-3ab9-44e1-8b8d-e66b7d7d76b3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:18.475559 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-803a829a-3673-439c-b167-4bddb682da17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:18.477015 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-803a829a-3673-439c-b167-4bddb682da17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:18.493653 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-803a829a-3673-439c-b167-4bddb682da17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:18.499793 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-803a829a-3673-439c-b167-4bddb682da17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:18.506131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-803a829a-3673-439c-b167-4bddb682da17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:18.507567 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-803a829a-3673-439c-b167-4bddb682da17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:18.513549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-803a829a-3673-439c-b167-4bddb682da17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:18.516975 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-803a829a-3673-439c-b167-4bddb682da17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:18.817148 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-5132a9a6-3ab9-44e1-8b8d-e66b7d7d76b3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:18.819393 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-803a829a-3673-439c-b167-4bddb682da17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:18.827036 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-5132a9a6-3ab9-44e1-8b8d-e66b7d7d76b3 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1570 microversion: 2.1 time: 0.428584 Oct 03 12:56:18.827737 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-803a829a-3673-439c-b167-4bddb682da17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:18.828337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 385/769] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:18 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1570 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:18.829332 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-803a829a-3673-439c-b167-4bddb682da17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:18.830505 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-803a829a-3673-439c-b167-4bddb682da17 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1732 microversion: 2.20 time: 0.360211 Oct 03 12:56:18.841022 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 385/770] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:18 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1732 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:56:18.854031 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-9704357d-d97e-4c89-9be2-f7aa55ca4768 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:56:18.857195 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-9704357d-d97e-4c89-9be2-f7aa55ca4768 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:18.861167 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9704357d-d97e-4c89-9be2-f7aa55ca4768 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:18.861654 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9704357d-d97e-4c89-9be2-f7aa55ca4768 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:18.862089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9704357d-d97e-4c89-9be2-f7aa55ca4768 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:18.862795 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9704357d-d97e-4c89-9be2-f7aa55ca4768 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:18.863941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9704357d-d97e-4c89-9be2-f7aa55ca4768 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:18.864488 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9704357d-d97e-4c89-9be2-f7aa55ca4768 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:18.922857 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-9704357d-d97e-4c89-9be2-f7aa55ca4768 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127542) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 12:56:19.239755 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-9704357d-d97e-4c89-9be2-f7aa55ca4768 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "POST /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5/action" status: 202 len: 0 microversion: 2.1 time: 0.387694 Oct 03 12:56:19.247186 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 386/771] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 12:56:18 2022] POST /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:56:19.265219 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-514f730d-0ba5-41b5-adb7-7a516e84b8ea tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:19.267521 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-514f730d-0ba5-41b5-adb7-7a516e84b8ea tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:19.292745 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-514f730d-0ba5-41b5-adb7-7a516e84b8ea tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:19.295511 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-514f730d-0ba5-41b5-adb7-7a516e84b8ea tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:19.299254 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-514f730d-0ba5-41b5-adb7-7a516e84b8ea tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:19.302807 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-514f730d-0ba5-41b5-adb7-7a516e84b8ea tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:19.303778 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-514f730d-0ba5-41b5-adb7-7a516e84b8ea tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:19.305002 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-514f730d-0ba5-41b5-adb7-7a516e84b8ea tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:19.686870 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-514f730d-0ba5-41b5-adb7-7a516e84b8ea tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:19.711475 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-514f730d-0ba5-41b5-adb7-7a516e84b8ea tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1518 microversion: 2.1 time: 0.464787 Oct 03 12:56:19.714698 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 386/772] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:19 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1518 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:19.749814 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-27faaba2-1592-4f9d-8983-cc2275bc9a93 req-42d4562c-8a0a-4a2b-8781-1c0583b245f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a54301-d1b8-4060-b712-8d707bcfbef5", "name": "network-vif-unplugged", "status": "completed", "tag": "7deec46d-97bb-4a3f-a77b-11832cd2ffe1"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:56:19.766935 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-27faaba2-1592-4f9d-8983-cc2275bc9a93 req-42d4562c-8a0a-4a2b-8781-1c0583b245f1 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:19.772297 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-27faaba2-1592-4f9d-8983-cc2275bc9a93 req-42d4562c-8a0a-4a2b-8781-1c0583b245f1 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:19.772297 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-27faaba2-1592-4f9d-8983-cc2275bc9a93 req-42d4562c-8a0a-4a2b-8781-1c0583b245f1 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:19.802949 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.compute.server_external_events [req-27faaba2-1592-4f9d-8983-cc2275bc9a93 req-42d4562c-8a0a-4a2b-8781-1c0583b245f1 service nova] Unable to find a host for instance e3a54301-d1b8-4060-b712-8d707bcfbef5. Dropping event network-vif-unplugged {{(pid=127542) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 03 12:56:19.805741 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-27faaba2-1592-4f9d-8983-cc2275bc9a93 req-42d4562c-8a0a-4a2b-8781-1c0583b245f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.061191 Oct 03 12:56:19.808344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 387/773] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 65 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 03 12:56:19.862571 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c8e6059b-3882-4f6e-9e86-e01fbe8a9b13 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:19.863760 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-c8e6059b-3882-4f6e-9e86-e01fbe8a9b13 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:19.871700 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c8e6059b-3882-4f6e-9e86-e01fbe8a9b13 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:19.873764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c8e6059b-3882-4f6e-9e86-e01fbe8a9b13 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:19.874207 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c8e6059b-3882-4f6e-9e86-e01fbe8a9b13 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:19.874919 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c8e6059b-3882-4f6e-9e86-e01fbe8a9b13 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:19.876381 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c8e6059b-3882-4f6e-9e86-e01fbe8a9b13 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:19.879381 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c8e6059b-3882-4f6e-9e86-e01fbe8a9b13 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:20.172871 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c8e6059b-3882-4f6e-9e86-e01fbe8a9b13 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:20.185213 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c8e6059b-3882-4f6e-9e86-e01fbe8a9b13 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:20.187519 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c8e6059b-3882-4f6e-9e86-e01fbe8a9b13 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:20.189208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c8e6059b-3882-4f6e-9e86-e01fbe8a9b13 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1732 microversion: 2.20 time: 0.335100 Oct 03 12:56:20.190827 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 387/774] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:19 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1732 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:56:20.743705 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-352a4a3d-ad67-426b-b94c-2eb4acd8d6cc tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:20.744433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-352a4a3d-ad67-426b-b94c-2eb4acd8d6cc tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:20.752560 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-352a4a3d-ad67-426b-b94c-2eb4acd8d6cc tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:20.755948 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-352a4a3d-ad67-426b-b94c-2eb4acd8d6cc tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:20.757018 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-352a4a3d-ad67-426b-b94c-2eb4acd8d6cc tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:20.757937 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-352a4a3d-ad67-426b-b94c-2eb4acd8d6cc tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:20.758619 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-352a4a3d-ad67-426b-b94c-2eb4acd8d6cc tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:20.759353 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-352a4a3d-ad67-426b-b94c-2eb4acd8d6cc tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:20.985874 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-352a4a3d-ad67-426b-b94c-2eb4acd8d6cc tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:20.995631 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-352a4a3d-ad67-426b-b94c-2eb4acd8d6cc tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1518 microversion: 2.1 time: 0.258532 Oct 03 12:56:20.996266 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 388/775] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:20 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1518 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:21.147000 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-17e7cbb7-a8bd-48c0-8119-218dd4b0b569 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Action: 'create', calling method: .version_select at 0x7fc740126ee0>, body: {"keypair": {"name": "tempest-keypair-1175916272", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVfzRlCvL9FGhD4XqngGcyd2xcgin8golRKlFfCQjhCq8YJ9sGsPKZuOaNS/LHlVwOVhRNEazYXvzjaeLh73BVVYNAik+t9cw0w870vmguTnGAHEPjqcYYjoVP6eLogmQ=="}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:56:21.167459 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-17e7cbb7-a8bd-48c0-8119-218dd4b0b569 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Getting quotas for project 484522301976426dae50e64c141c727e. Resources: {'key_pairs'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:56:21.171633 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-17e7cbb7-a8bd-48c0-8119-218dd4b0b569 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Getting quotas for user 5e29a4c0276247c286cff3eed5a1253a and project 484522301976426dae50e64c141c727e. Resources: {'key_pairs'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:56:21.219897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1a3a601e-ab39-4458-8fbb-65a04c0f5ac6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:21.224266 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-1a3a601e-ab39-4458-8fbb-65a04c0f5ac6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:21.232332 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1a3a601e-ab39-4458-8fbb-65a04c0f5ac6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:21.238435 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1a3a601e-ab39-4458-8fbb-65a04c0f5ac6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:21.238435 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1a3a601e-ab39-4458-8fbb-65a04c0f5ac6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:21.238435 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1a3a601e-ab39-4458-8fbb-65a04c0f5ac6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:21.238435 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1a3a601e-ab39-4458-8fbb-65a04c0f5ac6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:21.238844 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1a3a601e-ab39-4458-8fbb-65a04c0f5ac6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:21.292674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-17e7cbb7-a8bd-48c0-8119-218dd4b0b569 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.209650 Oct 03 12:56:21.293854 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 388/776] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 12:56:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:56:21.403653 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-1a3a601e-ab39-4458-8fbb-65a04c0f5ac6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:21.424390 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-1a3a601e-ab39-4458-8fbb-65a04c0f5ac6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:21.426080 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-1a3a601e-ab39-4458-8fbb-65a04c0f5ac6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:21.427396 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-1a3a601e-ab39-4458-8fbb-65a04c0f5ac6 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1732 microversion: 2.20 time: 0.214949 Oct 03 12:56:21.444931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 389/777] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:21 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1732 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 12:56:22.020240 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c4156d56-586a-4b9d-9c74-ef7b039d28cd tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:22.032645 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-c4156d56-586a-4b9d-9c74-ef7b039d28cd tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:22.032645 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c4156d56-586a-4b9d-9c74-ef7b039d28cd tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:22.032645 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c4156d56-586a-4b9d-9c74-ef7b039d28cd tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:22.032645 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c4156d56-586a-4b9d-9c74-ef7b039d28cd tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:22.033244 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c4156d56-586a-4b9d-9c74-ef7b039d28cd tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:22.033244 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c4156d56-586a-4b9d-9c74-ef7b039d28cd tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:22.033244 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c4156d56-586a-4b9d-9c74-ef7b039d28cd tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:22.185500 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c4156d56-586a-4b9d-9c74-ef7b039d28cd tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:22.198745 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c4156d56-586a-4b9d-9c74-ef7b039d28cd tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1520 microversion: 2.1 time: 0.183303 Oct 03 12:56:22.199391 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 389/778] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:22 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:22.455793 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8d454770-fd53-4349-82e7-c607115ea01b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:22.458008 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8d454770-fd53-4349-82e7-c607115ea01b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:22.464923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d454770-fd53-4349-82e7-c607115ea01b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:22.465683 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d454770-fd53-4349-82e7-c607115ea01b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:22.466103 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d454770-fd53-4349-82e7-c607115ea01b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:22.466802 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d454770-fd53-4349-82e7-c607115ea01b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:22.467903 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d454770-fd53-4349-82e7-c607115ea01b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:22.468537 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8d454770-fd53-4349-82e7-c607115ea01b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:22.631189 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8d454770-fd53-4349-82e7-c607115ea01b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:22.639666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8d454770-fd53-4349-82e7-c607115ea01b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:22.641446 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-8d454770-fd53-4349-82e7-c607115ea01b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:22.642774 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8d454770-fd53-4349-82e7-c607115ea01b tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1719 microversion: 2.20 time: 0.192434 Oct 03 12:56:22.643457 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 390/779] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:22 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1719 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:56:23.224385 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-900f0c77-d117-4221-a35b-43d4a76100e6 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:23.225655 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-900f0c77-d117-4221-a35b-43d4a76100e6 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:23.232473 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-900f0c77-d117-4221-a35b-43d4a76100e6 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:23.233303 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-900f0c77-d117-4221-a35b-43d4a76100e6 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:23.233990 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-900f0c77-d117-4221-a35b-43d4a76100e6 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:23.234702 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-900f0c77-d117-4221-a35b-43d4a76100e6 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:23.235371 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-900f0c77-d117-4221-a35b-43d4a76100e6 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:23.235961 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-900f0c77-d117-4221-a35b-43d4a76100e6 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:23.468229 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-900f0c77-d117-4221-a35b-43d4a76100e6 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:23.482351 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-900f0c77-d117-4221-a35b-43d4a76100e6 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1576 microversion: 2.1 time: 0.260107 Oct 03 12:56:23.487911 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 390/780] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:23 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1576 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:24.002357 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1618015451", "imageRef": "9d585789-e496-433d-b311-70ec7ceffd99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c116e69-b6ec-41cd-b2b6-637e304e9d46"}], "security_groups": [{"name": "tempest-securitygroup--333088473"}], "key_name": "tempest-keypair-1175916272", "user_data": "}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:56:24.125952 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.network.neutron [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] validate_networks() for [('1c116e69-b6ec-41cd-b2b6-637e304e9d46', None, None, None, None, None)] {{(pid=127542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:56:24.506164 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-5c585cea-1fb3-4689-902e-d90bf6ee640d tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:24.507008 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-5c585cea-1fb3-4689-902e-d90bf6ee640d tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:24.512851 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Flavor limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:56:24.513271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Image limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:56:24.513675 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c585cea-1fb3-4689-902e-d90bf6ee640d tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:24.513818 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Flavor pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:56:24.514136 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Image pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:56:24.514258 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c585cea-1fb3-4689-902e-d90bf6ee640d tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:24.514547 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:56:24.514647 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c585cea-1fb3-4689-902e-d90bf6ee640d tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:24.515266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c585cea-1fb3-4689-902e-d90bf6ee640d tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:24.515897 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c585cea-1fb3-4689-902e-d90bf6ee640d tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:24.516321 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5c585cea-1fb3-4689-902e-d90bf6ee640d tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:24.523462 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:24.524019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:24.524468 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:24.525182 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:24.525636 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:24.526059 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:24.543641 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Getting quotas for project 484522301976426dae50e64c141c727e. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:56:24.547727 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Getting quotas for user 5e29a4c0276247c286cff3eed5a1253a and project 484522301976426dae50e64c141c727e. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:56:24.559602 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Going to run 1 instances... {{(pid=127542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:56:24.561952 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d585789-e496-433d-b311-70ec7ceffd99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:56:24.646137 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5c585cea-1fb3-4689-902e-d90bf6ee640d tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:24.653924 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-5c585cea-1fb3-4689-902e-d90bf6ee640d tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1576 microversion: 2.1 time: 0.152302 Oct 03 12:56:24.654487 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 391/781] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:24 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:24.740303 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8fce8bea-f471-44ca-a998-86c59847db71 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.742364 Oct 03 12:56:24.741368 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 391/782] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:56:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:56:24.752142 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-f87effce-68b8-453f-81da-a773656e76c3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:24.752756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-f87effce-68b8-453f-81da-a773656e76c3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:24.809868 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-f87effce-68b8-453f-81da-a773656e76c3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:24.817403 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-f87effce-68b8-453f-81da-a773656e76c3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 200 len: 1242 microversion: 2.1 time: 0.069004 Oct 03 12:56:24.818916 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 392/783] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:24 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:25.678429 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7fd8a643-cf1a-428c-8e72-41db8b86e4d4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:25.679070 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-7fd8a643-cf1a-428c-8e72-41db8b86e4d4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:25.685777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7fd8a643-cf1a-428c-8e72-41db8b86e4d4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:25.686292 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7fd8a643-cf1a-428c-8e72-41db8b86e4d4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:25.686727 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7fd8a643-cf1a-428c-8e72-41db8b86e4d4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:25.687459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7fd8a643-cf1a-428c-8e72-41db8b86e4d4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:25.687916 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7fd8a643-cf1a-428c-8e72-41db8b86e4d4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:25.688344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7fd8a643-cf1a-428c-8e72-41db8b86e4d4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:25.819119 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-7fd8a643-cf1a-428c-8e72-41db8b86e4d4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:25.827106 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-7fd8a643-cf1a-428c-8e72-41db8b86e4d4 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1576 microversion: 2.1 time: 0.153788 Oct 03 12:56:25.827739 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 392/784] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:25 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:25.850208 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-991d06c4-c0e3-427b-9a77-0c684f1d5cb5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:25.851065 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-991d06c4-c0e3-427b-9a77-0c684f1d5cb5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:25.905333 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-991d06c4-c0e3-427b-9a77-0c684f1d5cb5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:25.912894 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-991d06c4-c0e3-427b-9a77-0c684f1d5cb5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 200 len: 1242 microversion: 2.1 time: 0.066841 Oct 03 12:56:25.913452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 393/785] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:25 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:26.850524 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-661f7ce1-6659-43d3-984d-32b3f0ba6e08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:26.851238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-661f7ce1-6659-43d3-984d-32b3f0ba6e08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:26.857810 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661f7ce1-6659-43d3-984d-32b3f0ba6e08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:26.858296 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661f7ce1-6659-43d3-984d-32b3f0ba6e08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:26.858740 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661f7ce1-6659-43d3-984d-32b3f0ba6e08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:26.859466 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661f7ce1-6659-43d3-984d-32b3f0ba6e08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:26.859924 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661f7ce1-6659-43d3-984d-32b3f0ba6e08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:26.860349 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-661f7ce1-6659-43d3-984d-32b3f0ba6e08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:26.879100 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:56:26.936031 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-02e105ea-508d-42b7-a90f-828e7cfb8fdb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:26.936632 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-02e105ea-508d-42b7-a90f-828e7cfb8fdb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:26.946198 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02e105ea-508d-42b7-a90f-828e7cfb8fdb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:26.946198 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02e105ea-508d-42b7-a90f-828e7cfb8fdb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:26.946198 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02e105ea-508d-42b7-a90f-828e7cfb8fdb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:26.946717 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02e105ea-508d-42b7-a90f-828e7cfb8fdb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:26.947182 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02e105ea-508d-42b7-a90f-828e7cfb8fdb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:26.947642 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02e105ea-508d-42b7-a90f-828e7cfb8fdb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:27.007537 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-661f7ce1-6659-43d3-984d-32b3f0ba6e08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:27.015212 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-661f7ce1-6659-43d3-984d-32b3f0ba6e08 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1576 microversion: 2.1 time: 0.169044 Oct 03 12:56:27.015840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 393/786] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:26 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:27.025752 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-02e105ea-508d-42b7-a90f-828e7cfb8fdb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:27.032345 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-02e105ea-508d-42b7-a90f-828e7cfb8fdb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 200 len: 1294 microversion: 2.1 time: 0.100243 Oct 03 12:56:27.032910 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 394/787] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:26 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 1294 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:28.039535 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a557d480-2c2b-4ccb-97af-5408378d476a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:28.040152 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a557d480-2c2b-4ccb-97af-5408378d476a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:28.046812 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a557d480-2c2b-4ccb-97af-5408378d476a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:28.047346 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a557d480-2c2b-4ccb-97af-5408378d476a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:28.047797 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a557d480-2c2b-4ccb-97af-5408378d476a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:28.048487 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a557d480-2c2b-4ccb-97af-5408378d476a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:28.048984 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a557d480-2c2b-4ccb-97af-5408378d476a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:28.049366 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a557d480-2c2b-4ccb-97af-5408378d476a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:28.055515 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ad7e9f31-edb6-4aed-8c9b-f8e6c05ca5a8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:28.056149 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ad7e9f31-edb6-4aed-8c9b-f8e6c05ca5a8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:28.062634 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ad7e9f31-edb6-4aed-8c9b-f8e6c05ca5a8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:28.063266 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ad7e9f31-edb6-4aed-8c9b-f8e6c05ca5a8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:28.063723 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ad7e9f31-edb6-4aed-8c9b-f8e6c05ca5a8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:28.064419 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ad7e9f31-edb6-4aed-8c9b-f8e6c05ca5a8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:28.064868 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ad7e9f31-edb6-4aed-8c9b-f8e6c05ca5a8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:28.065287 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ad7e9f31-edb6-4aed-8c9b-f8e6c05ca5a8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:28.149799 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-ad7e9f31-edb6-4aed-8c9b-f8e6c05ca5a8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:28.157577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ad7e9f31-edb6-4aed-8c9b-f8e6c05ca5a8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 200 len: 1300 microversion: 2.1 time: 0.107007 Oct 03 12:56:28.158772 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 395/788] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:28 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:28.221367 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a557d480-2c2b-4ccb-97af-5408378d476a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:28.233218 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a557d480-2c2b-4ccb-97af-5408378d476a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1576 microversion: 2.1 time: 0.197600 Oct 03 12:56:28.234163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 394/789] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:28 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1576 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:29.181969 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-4f8e61b6-8348-48cd-bca5-b55653199a4d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:29.182604 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-4f8e61b6-8348-48cd-bca5-b55653199a4d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:29.184198 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-4f205af4-8801-4371-9a7c-e607657b6c48 req-3262e623-5dfe-43fb-aa37-f3392738788b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7601de3-6bca-4b56-900b-e5bce92c1286", "tag": "4edf1405-fc52-4599-ac23-ab2575e40645"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:56:29.189210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f8e61b6-8348-48cd-bca5-b55653199a4d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:29.192469 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f8e61b6-8348-48cd-bca5-b55653199a4d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:29.192469 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f8e61b6-8348-48cd-bca5-b55653199a4d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:29.192469 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f8e61b6-8348-48cd-bca5-b55653199a4d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:29.192469 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f8e61b6-8348-48cd-bca5-b55653199a4d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:29.192877 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4f8e61b6-8348-48cd-bca5-b55653199a4d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:29.195700 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-4f205af4-8801-4371-9a7c-e607657b6c48 req-3262e623-5dfe-43fb-aa37-f3392738788b service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:29.196311 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-4f205af4-8801-4371-9a7c-e607657b6c48 req-3262e623-5dfe-43fb-aa37-f3392738788b service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:29.198302 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-4f205af4-8801-4371-9a7c-e607657b6c48 req-3262e623-5dfe-43fb-aa37-f3392738788b service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:29.210812 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-4f205af4-8801-4371-9a7c-e607657b6c48 req-3262e623-5dfe-43fb-aa37-f3392738788b service nova] Creating event network-changed:4edf1405-fc52-4599-ac23-ab2575e40645 for instance a7601de3-6bca-4b56-900b-e5bce92c1286 on hv-cinder-84456 Oct 03 12:56:29.216110 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-4f205af4-8801-4371-9a7c-e607657b6c48 req-3262e623-5dfe-43fb-aa37-f3392738788b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035818 Oct 03 12:56:29.217124 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 395/790] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:56:29.260664 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7ce1d1ff-b147-479a-9014-68fb3bbeec52 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:29.261368 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-7ce1d1ff-b147-479a-9014-68fb3bbeec52 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:29.273617 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7ce1d1ff-b147-479a-9014-68fb3bbeec52 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:29.274118 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7ce1d1ff-b147-479a-9014-68fb3bbeec52 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:29.274819 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7ce1d1ff-b147-479a-9014-68fb3bbeec52 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:29.275241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7ce1d1ff-b147-479a-9014-68fb3bbeec52 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:29.275718 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7ce1d1ff-b147-479a-9014-68fb3bbeec52 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:29.276494 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7ce1d1ff-b147-479a-9014-68fb3bbeec52 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:29.355093 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4f8e61b6-8348-48cd-bca5-b55653199a4d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:29.364465 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-4f8e61b6-8348-48cd-bca5-b55653199a4d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 200 len: 1367 microversion: 2.1 time: 0.185597 Oct 03 12:56:29.365116 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 396/791] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:29 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:29.420117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-7ce1d1ff-b147-479a-9014-68fb3bbeec52 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:29.428638 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-7ce1d1ff-b147-479a-9014-68fb3bbeec52 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1576 microversion: 2.1 time: 0.174127 Oct 03 12:56:29.429210 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 396/792] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:29 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:30.389519 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-80bcb48f-1b76-4f45-8e7e-89ccabee14f1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:30.390138 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-80bcb48f-1b76-4f45-8e7e-89ccabee14f1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:30.397202 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-80bcb48f-1b76-4f45-8e7e-89ccabee14f1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:30.397686 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-80bcb48f-1b76-4f45-8e7e-89ccabee14f1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:30.398116 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-80bcb48f-1b76-4f45-8e7e-89ccabee14f1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:30.398801 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-80bcb48f-1b76-4f45-8e7e-89ccabee14f1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:30.399252 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-80bcb48f-1b76-4f45-8e7e-89ccabee14f1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:30.399784 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-80bcb48f-1b76-4f45-8e7e-89ccabee14f1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:30.451400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-6eae4198-d574-4f4e-83a5-fc9da63f0331 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:30.452015 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-6eae4198-d574-4f4e-83a5-fc9da63f0331 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:30.459088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6eae4198-d574-4f4e-83a5-fc9da63f0331 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:30.459607 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6eae4198-d574-4f4e-83a5-fc9da63f0331 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:30.460046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6eae4198-d574-4f4e-83a5-fc9da63f0331 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:30.460798 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6eae4198-d574-4f4e-83a5-fc9da63f0331 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:30.461259 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6eae4198-d574-4f4e-83a5-fc9da63f0331 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:30.462627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6eae4198-d574-4f4e-83a5-fc9da63f0331 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:30.575279 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-80bcb48f-1b76-4f45-8e7e-89ccabee14f1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:30.583902 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-80bcb48f-1b76-4f45-8e7e-89ccabee14f1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 200 len: 1367 microversion: 2.1 time: 0.198322 Oct 03 12:56:30.584501 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 397/793] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:30 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:30.622405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6eae4198-d574-4f4e-83a5-fc9da63f0331 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:30.630674 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-6eae4198-d574-4f4e-83a5-fc9da63f0331 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1576 microversion: 2.1 time: 0.183211 Oct 03 12:56:30.631242 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 397/794] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:30 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:31.607412 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a8bd0438-c9f3-4669-a77c-3b7645985da3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:31.608148 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a8bd0438-c9f3-4669-a77c-3b7645985da3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:31.615181 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a8bd0438-c9f3-4669-a77c-3b7645985da3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:31.615696 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a8bd0438-c9f3-4669-a77c-3b7645985da3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:31.616388 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a8bd0438-c9f3-4669-a77c-3b7645985da3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:31.617079 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a8bd0438-c9f3-4669-a77c-3b7645985da3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:31.617529 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a8bd0438-c9f3-4669-a77c-3b7645985da3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:31.617949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a8bd0438-c9f3-4669-a77c-3b7645985da3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:31.653716 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1b004373-1ecf-4664-b93e-3b82053b6e41 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:31.679005 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-1b004373-1ecf-4664-b93e-3b82053b6e41 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:31.679005 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b004373-1ecf-4664-b93e-3b82053b6e41 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:31.679005 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b004373-1ecf-4664-b93e-3b82053b6e41 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:31.679005 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b004373-1ecf-4664-b93e-3b82053b6e41 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:31.679448 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b004373-1ecf-4664-b93e-3b82053b6e41 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:31.679448 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b004373-1ecf-4664-b93e-3b82053b6e41 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:31.679448 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1b004373-1ecf-4664-b93e-3b82053b6e41 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:31.803110 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-a8bd0438-c9f3-4669-a77c-3b7645985da3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:31.811021 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a8bd0438-c9f3-4669-a77c-3b7645985da3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 200 len: 1367 microversion: 2.1 time: 0.207363 Oct 03 12:56:31.811974 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 398/795] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:31 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:31.837490 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-1b004373-1ecf-4664-b93e-3b82053b6e41 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:31.846136 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-1b004373-1ecf-4664-b93e-3b82053b6e41 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1576 microversion: 2.1 time: 0.196005 Oct 03 12:56:31.847041 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 398/796] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:31 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:32.834154 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d9af6bb0-d410-42c9-9ae5-23f4b96c7ac6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:32.834770 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d9af6bb0-d410-42c9-9ae5-23f4b96c7ac6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:32.841572 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d9af6bb0-d410-42c9-9ae5-23f4b96c7ac6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:32.842052 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d9af6bb0-d410-42c9-9ae5-23f4b96c7ac6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:32.842484 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d9af6bb0-d410-42c9-9ae5-23f4b96c7ac6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:32.843213 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d9af6bb0-d410-42c9-9ae5-23f4b96c7ac6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:32.843689 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d9af6bb0-d410-42c9-9ae5-23f4b96c7ac6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:32.844109 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d9af6bb0-d410-42c9-9ae5-23f4b96c7ac6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:32.869767 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-44342c02-4f4a-4f35-ae71-01c2c4211e2f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:32.870484 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-44342c02-4f4a-4f35-ae71-01c2c4211e2f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:32.877064 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44342c02-4f4a-4f35-ae71-01c2c4211e2f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:32.877554 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44342c02-4f4a-4f35-ae71-01c2c4211e2f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:32.877995 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44342c02-4f4a-4f35-ae71-01c2c4211e2f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:32.878694 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44342c02-4f4a-4f35-ae71-01c2c4211e2f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:32.879260 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44342c02-4f4a-4f35-ae71-01c2c4211e2f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:32.879694 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44342c02-4f4a-4f35-ae71-01c2c4211e2f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:33.025233 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d9af6bb0-d410-42c9-9ae5-23f4b96c7ac6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:33.027644 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=100 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:56:33.033895 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d9af6bb0-d410-42c9-9ae5-23f4b96c7ac6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 200 len: 1367 microversion: 2.1 time: 0.203672 Oct 03 12:56:33.034476 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 399/797] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:32 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:33.053363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-44342c02-4f4a-4f35-ae71-01c2c4211e2f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:33.061028 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-44342c02-4f4a-4f35-ae71-01c2c4211e2f tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1576 microversion: 2.1 time: 0.195332 Oct 03 12:56:33.061596 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 399/798] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:32 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:33.768293 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-0cb507da-f268-44f9-93d1-ac10fe9e2629 req-7618a9f7-dfef-4d79-a724-745430f1134a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7601de3-6bca-4b56-900b-e5bce92c1286", "name": "network-vif-plugged", "status": "completed", "tag": "4edf1405-fc52-4599-ac23-ab2575e40645"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:56:33.775866 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-0cb507da-f268-44f9-93d1-ac10fe9e2629 req-7618a9f7-dfef-4d79-a724-745430f1134a service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:33.776343 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-0cb507da-f268-44f9-93d1-ac10fe9e2629 req-7618a9f7-dfef-4d79-a724-745430f1134a service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:33.776767 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-0cb507da-f268-44f9-93d1-ac10fe9e2629 req-7618a9f7-dfef-4d79-a724-745430f1134a service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:33.788064 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-0cb507da-f268-44f9-93d1-ac10fe9e2629 req-7618a9f7-dfef-4d79-a724-745430f1134a service nova] Creating event network-vif-plugged:4edf1405-fc52-4599-ac23-ab2575e40645 for instance a7601de3-6bca-4b56-900b-e5bce92c1286 on hv-cinder-84456 Oct 03 12:56:33.794097 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-0cb507da-f268-44f9-93d1-ac10fe9e2629 req-7618a9f7-dfef-4d79-a724-745430f1134a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032024 Oct 03 12:56:33.797739 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 400/799] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:56:34.058359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-62559379-b5f8-4629-af3e-9baab7c3ae09 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:34.059216 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-62559379-b5f8-4629-af3e-9baab7c3ae09 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:34.065704 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-62559379-b5f8-4629-af3e-9baab7c3ae09 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:34.066282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-62559379-b5f8-4629-af3e-9baab7c3ae09 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:34.067681 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-62559379-b5f8-4629-af3e-9baab7c3ae09 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:34.068470 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-62559379-b5f8-4629-af3e-9baab7c3ae09 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:34.069028 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-62559379-b5f8-4629-af3e-9baab7c3ae09 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:34.069454 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-62559379-b5f8-4629-af3e-9baab7c3ae09 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:34.085089 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-24e24534-b273-4bad-b4db-e4ae7d63a5f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:34.085800 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-24e24534-b273-4bad-b4db-e4ae7d63a5f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:34.092215 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24e24534-b273-4bad-b4db-e4ae7d63a5f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:34.092710 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24e24534-b273-4bad-b4db-e4ae7d63a5f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:34.093153 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24e24534-b273-4bad-b4db-e4ae7d63a5f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:34.093860 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24e24534-b273-4bad-b4db-e4ae7d63a5f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:34.094323 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24e24534-b273-4bad-b4db-e4ae7d63a5f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:34.094952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-24e24534-b273-4bad-b4db-e4ae7d63a5f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:34.287186 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-62559379-b5f8-4629-af3e-9baab7c3ae09 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:34.293239 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-24e24534-b273-4bad-b4db-e4ae7d63a5f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:34.295132 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-62559379-b5f8-4629-af3e-9baab7c3ae09 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 200 len: 1367 microversion: 2.1 time: 0.240575 Oct 03 12:56:34.295743 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 400/800] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:34 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:34.301781 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-24e24534-b273-4bad-b4db-e4ae7d63a5f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1576 microversion: 2.1 time: 0.220889 Oct 03 12:56:34.302726 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 401/801] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:34 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1576 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:35.318832 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4d6cb001-ecc4-4475-afa3-744b8479810e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:35.319479 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-4d6cb001-ecc4-4475-afa3-744b8479810e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:35.321456 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:56:35.322134 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=6 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:56:35.327393 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4d6cb001-ecc4-4475-afa3-744b8479810e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:35.327887 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4d6cb001-ecc4-4475-afa3-744b8479810e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:35.328325 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4d6cb001-ecc4-4475-afa3-744b8479810e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:35.329031 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4d6cb001-ecc4-4475-afa3-744b8479810e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:35.330987 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4d6cb001-ecc4-4475-afa3-744b8479810e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:35.331481 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4d6cb001-ecc4-4475-afa3-744b8479810e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:35.336008 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8f4fa132-e219-433a-9194-2ef1f2257195 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:35.336623 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8f4fa132-e219-433a-9194-2ef1f2257195 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:35.343052 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f4fa132-e219-433a-9194-2ef1f2257195 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:35.343578 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f4fa132-e219-433a-9194-2ef1f2257195 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:35.344015 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f4fa132-e219-433a-9194-2ef1f2257195 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:35.344709 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f4fa132-e219-433a-9194-2ef1f2257195 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:35.345169 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f4fa132-e219-433a-9194-2ef1f2257195 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:35.346718 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8f4fa132-e219-433a-9194-2ef1f2257195 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:35.535145 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4d6cb001-ecc4-4475-afa3-744b8479810e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:35.540349 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8f4fa132-e219-433a-9194-2ef1f2257195 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:35.543701 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-4d6cb001-ecc4-4475-afa3-744b8479810e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 200 len: 1367 microversion: 2.1 time: 0.228617 Oct 03 12:56:35.544278 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 401/802] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:35 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:35.548481 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-8f4fa132-e219-433a-9194-2ef1f2257195 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1576 microversion: 2.1 time: 0.216543 Oct 03 12:56:35.549041 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 402/803] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:35 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:35.809685 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-c4be1c9e-980a-4823-b702-d9314e017810 req-c0e2359d-9385-4016-87cc-42554317b8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a54301-d1b8-4060-b712-8d707bcfbef5", "name": "network-vif-plugged", "status": "completed", "tag": "7deec46d-97bb-4a3f-a77b-11832cd2ffe1"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:56:35.819608 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-c4be1c9e-980a-4823-b702-d9314e017810 req-c0e2359d-9385-4016-87cc-42554317b8e4 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:35.820087 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-c4be1c9e-980a-4823-b702-d9314e017810 req-c0e2359d-9385-4016-87cc-42554317b8e4 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:35.820519 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-c4be1c9e-980a-4823-b702-d9314e017810 req-c0e2359d-9385-4016-87cc-42554317b8e4 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:35.831432 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-c4be1c9e-980a-4823-b702-d9314e017810 req-c0e2359d-9385-4016-87cc-42554317b8e4 service nova] Creating event network-vif-plugged:7deec46d-97bb-4a3f-a77b-11832cd2ffe1 for instance e3a54301-d1b8-4060-b712-8d707bcfbef5 on hv-cinder-84456 Oct 03 12:56:35.836997 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-c4be1c9e-980a-4823-b702-d9314e017810 req-c0e2359d-9385-4016-87cc-42554317b8e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030915 Oct 03 12:56:35.837654 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 402/804] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:56:36.566227 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a6409842-7efb-4be5-b267-3df18fd46bdc tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:36.567515 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a6409842-7efb-4be5-b267-3df18fd46bdc tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:36.569667 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=8 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:56:36.572926 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ba211328-cc3a-4de1-9fb9-7cb8836f077a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:36.573750 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-ba211328-cc3a-4de1-9fb9-7cb8836f077a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:36.575065 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6409842-7efb-4be5-b267-3df18fd46bdc tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:36.575590 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6409842-7efb-4be5-b267-3df18fd46bdc tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:36.576059 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6409842-7efb-4be5-b267-3df18fd46bdc tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:36.576758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6409842-7efb-4be5-b267-3df18fd46bdc tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:36.577217 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6409842-7efb-4be5-b267-3df18fd46bdc tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:36.577641 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a6409842-7efb-4be5-b267-3df18fd46bdc tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:36.579669 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ba211328-cc3a-4de1-9fb9-7cb8836f077a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:36.580153 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ba211328-cc3a-4de1-9fb9-7cb8836f077a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:36.580586 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ba211328-cc3a-4de1-9fb9-7cb8836f077a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:36.581278 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ba211328-cc3a-4de1-9fb9-7cb8836f077a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:36.581730 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ba211328-cc3a-4de1-9fb9-7cb8836f077a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:36.582360 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ba211328-cc3a-4de1-9fb9-7cb8836f077a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:36.775525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-ba211328-cc3a-4de1-9fb9-7cb8836f077a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:36.779653 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-a6409842-7efb-4be5-b267-3df18fd46bdc tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:36.783490 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-ba211328-cc3a-4de1-9fb9-7cb8836f077a tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1576 microversion: 2.1 time: 0.215060 Oct 03 12:56:36.784062 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 403/805] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:36 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1576 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:56:36.787769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a6409842-7efb-4be5-b267-3df18fd46bdc tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 200 len: 1557 microversion: 2.1 time: 0.225348 Oct 03 12:56:36.788336 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 403/806] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:36 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 1557 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:36.811555 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d57e21d1-e840-49cf-905a-db2d67f3f68b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:36.812056 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d57e21d1-e840-49cf-905a-db2d67f3f68b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:36.818412 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d57e21d1-e840-49cf-905a-db2d67f3f68b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:36.818845 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d57e21d1-e840-49cf-905a-db2d67f3f68b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:36.819287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d57e21d1-e840-49cf-905a-db2d67f3f68b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:36.820063 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d57e21d1-e840-49cf-905a-db2d67f3f68b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:36.820520 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d57e21d1-e840-49cf-905a-db2d67f3f68b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:36.820949 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d57e21d1-e840-49cf-905a-db2d67f3f68b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:36.903648 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d57e21d1-e840-49cf-905a-db2d67f3f68b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096014 Oct 03 12:56:36.904247 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 404/807] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Oct 3 12:56:36 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:56:37.807733 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-32dafa26-018b-4444-8935-c4b2ff1e50f7 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:37.808343 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-32dafa26-018b-4444-8935-c4b2ff1e50f7 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:37.815140 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-32dafa26-018b-4444-8935-c4b2ff1e50f7 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:37.815921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-32dafa26-018b-4444-8935-c4b2ff1e50f7 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:37.816361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-32dafa26-018b-4444-8935-c4b2ff1e50f7 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:37.817068 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-32dafa26-018b-4444-8935-c4b2ff1e50f7 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:37.817525 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-32dafa26-018b-4444-8935-c4b2ff1e50f7 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:37.818102 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-32dafa26-018b-4444-8935-c4b2ff1e50f7 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:38.236336 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-74e4ba1e-7e49-4b08-a9eb-d6f2cacd837e req-cca23372-598e-424c-bc61-3f18e002c107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7601de3-6bca-4b56-900b-e5bce92c1286", "tag": "4edf1405-fc52-4599-ac23-ab2575e40645"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:56:38.242293 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-32dafa26-018b-4444-8935-c4b2ff1e50f7 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:38.248032 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-74e4ba1e-7e49-4b08-a9eb-d6f2cacd837e req-cca23372-598e-424c-bc61-3f18e002c107 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:38.248032 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-74e4ba1e-7e49-4b08-a9eb-d6f2cacd837e req-cca23372-598e-424c-bc61-3f18e002c107 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:38.248032 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-74e4ba1e-7e49-4b08-a9eb-d6f2cacd837e req-cca23372-598e-424c-bc61-3f18e002c107 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:38.258093 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-32dafa26-018b-4444-8935-c4b2ff1e50f7 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1576 microversion: 2.1 time: 0.454060 Oct 03 12:56:38.271351 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 404/808] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:37 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1576 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:38.272063 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-74e4ba1e-7e49-4b08-a9eb-d6f2cacd837e req-cca23372-598e-424c-bc61-3f18e002c107 service nova] Creating event network-changed:4edf1405-fc52-4599-ac23-ab2575e40645 for instance a7601de3-6bca-4b56-900b-e5bce92c1286 on hv-cinder-84456 Oct 03 12:56:38.272063 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-74e4ba1e-7e49-4b08-a9eb-d6f2cacd837e req-cca23372-598e-424c-bc61-3f18e002c107 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034621 Oct 03 12:56:38.272063 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 405/809] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:56:39.284490 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-580bf685-3a63-4637-9a62-c48b1099c441 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:39.285098 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-580bf685-3a63-4637-9a62-c48b1099c441 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:39.291956 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-580bf685-3a63-4637-9a62-c48b1099c441 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:39.293336 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-580bf685-3a63-4637-9a62-c48b1099c441 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:39.293336 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-580bf685-3a63-4637-9a62-c48b1099c441 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:39.293811 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-580bf685-3a63-4637-9a62-c48b1099c441 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:39.294259 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-580bf685-3a63-4637-9a62-c48b1099c441 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:39.294708 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-580bf685-3a63-4637-9a62-c48b1099c441 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:39.435707 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-580bf685-3a63-4637-9a62-c48b1099c441 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:39.447829 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-580bf685-3a63-4637-9a62-c48b1099c441 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1563 microversion: 2.1 time: 0.167129 Oct 03 12:56:39.448437 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 405/810] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:56:39 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:55.904531 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:56:55.905346 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=60 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:56:55.909575 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-2267a9eb-6335-43c4-bf60-840bcdd8d0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:55.911823 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-2267a9eb-6335-43c4-bf60-840bcdd8d0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:55.918355 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2267a9eb-6335-43c4-bf60-840bcdd8d0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:55.918852 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2267a9eb-6335-43c4-bf60-840bcdd8d0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:55.919302 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2267a9eb-6335-43c4-bf60-840bcdd8d0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:55.920032 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2267a9eb-6335-43c4-bf60-840bcdd8d0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:55.920493 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2267a9eb-6335-43c4-bf60-840bcdd8d0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:55.920923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2267a9eb-6335-43c4-bf60-840bcdd8d0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:55.951207 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-2267a9eb-6335-43c4-bf60-840bcdd8d0dc tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048288 Oct 03 12:56:55.951790 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 406/811] 10.222.0.33 () {60 vars in 1343 bytes} [Mon Oct 3 12:56:55 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:56:56.016911 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-342c07a5-75b8-43dd-9ee3-9542c208880e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:56.017533 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-342c07a5-75b8-43dd-9ee3-9542c208880e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:56.020334 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:56:56.021200 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=33 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:56:56.027044 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-342c07a5-75b8-43dd-9ee3-9542c208880e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:56.027699 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-342c07a5-75b8-43dd-9ee3-9542c208880e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:56.028405 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-342c07a5-75b8-43dd-9ee3-9542c208880e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:56.029350 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-342c07a5-75b8-43dd-9ee3-9542c208880e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:56.029991 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-342c07a5-75b8-43dd-9ee3-9542c208880e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:56.030522 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-342c07a5-75b8-43dd-9ee3-9542c208880e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:56.063010 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-342c07a5-75b8-43dd-9ee3-9542c208880e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Going to try to terminate instance {{(pid=127544) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:56:56.418058 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-342c07a5-75b8-43dd-9ee3-9542c208880e tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 204 len: 0 microversion: 2.20 time: 0.405659 Oct 03 12:56:56.418841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 406/812] 10.222.0.33 () {60 vars in 1280 bytes} [Mon Oct 3 12:56:56 2022] DELETE /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 12:56:56.426958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-5fba93bb-7410-4b9c-af7f-ae2223ac1337 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:56.430974 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-5fba93bb-7410-4b9c-af7f-ae2223ac1337 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:56.435773 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5fba93bb-7410-4b9c-af7f-ae2223ac1337 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:56.436265 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5fba93bb-7410-4b9c-af7f-ae2223ac1337 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:56.436708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5fba93bb-7410-4b9c-af7f-ae2223ac1337 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:56.437405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5fba93bb-7410-4b9c-af7f-ae2223ac1337 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:56.437865 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5fba93bb-7410-4b9c-af7f-ae2223ac1337 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:56.438293 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5fba93bb-7410-4b9c-af7f-ae2223ac1337 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:56.567632 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-5fba93bb-7410-4b9c-af7f-ae2223ac1337 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:56.576591 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-5fba93bb-7410-4b9c-af7f-ae2223ac1337 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:56.578040 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-5fba93bb-7410-4b9c-af7f-ae2223ac1337 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:56.579213 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-5fba93bb-7410-4b9c-af7f-ae2223ac1337 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1725 microversion: 2.20 time: 0.156066 Oct 03 12:56:56.579894 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 407/813] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:56 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:56:57.605774 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-97151094-f652-4bee-ad43-9b8b5a19a91f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:57.606488 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-97151094-f652-4bee-ad43-9b8b5a19a91f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:57.612934 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-97151094-f652-4bee-ad43-9b8b5a19a91f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:57.613442 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-97151094-f652-4bee-ad43-9b8b5a19a91f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:57.613875 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-97151094-f652-4bee-ad43-9b8b5a19a91f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:57.614706 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-97151094-f652-4bee-ad43-9b8b5a19a91f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:57.615159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-97151094-f652-4bee-ad43-9b8b5a19a91f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:57.615612 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-97151094-f652-4bee-ad43-9b8b5a19a91f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:57.749530 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-97151094-f652-4bee-ad43-9b8b5a19a91f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:57.757385 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-97151094-f652-4bee-ad43-9b8b5a19a91f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:57.759442 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-97151094-f652-4bee-ad43-9b8b5a19a91f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:57.760594 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-97151094-f652-4bee-ad43-9b8b5a19a91f tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1725 microversion: 2.20 time: 0.159265 Oct 03 12:56:57.761151 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 407/814] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:57 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:56:58.785469 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c1d2780b-bda5-40f3-a243-3f227a13f25c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:58.786084 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c1d2780b-bda5-40f3-a243-3f227a13f25c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:58.792382 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c1d2780b-bda5-40f3-a243-3f227a13f25c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:58.792873 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c1d2780b-bda5-40f3-a243-3f227a13f25c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:58.793308 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c1d2780b-bda5-40f3-a243-3f227a13f25c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:58.794002 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c1d2780b-bda5-40f3-a243-3f227a13f25c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:58.794454 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c1d2780b-bda5-40f3-a243-3f227a13f25c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:58.794878 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c1d2780b-bda5-40f3-a243-3f227a13f25c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:58.857790 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c1d2780b-bda5-40f3-a243-3f227a13f25c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:58.865944 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c1d2780b-bda5-40f3-a243-3f227a13f25c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:58.867827 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c1d2780b-bda5-40f3-a243-3f227a13f25c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:58.868964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c1d2780b-bda5-40f3-a243-3f227a13f25c tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1657 microversion: 2.20 time: 0.087401 Oct 03 12:56:58.869525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 408/815] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:58 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1657 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:56:58.976742 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-055e4d75-a675-4c89-9912-4e144f31cf6c req-37d13f0d-f4b6-457a-b77c-1e61c6f1a533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b37dd24-5a6e-4898-8247-8e00786088ea", "name": "network-vif-deleted", "tag": "778fd61a-2cb6-43b5-ad14-c9a69f32bf7c"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:56:58.987120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-055e4d75-a675-4c89-9912-4e144f31cf6c req-37d13f0d-f4b6-457a-b77c-1e61c6f1a533 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:58.987623 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-055e4d75-a675-4c89-9912-4e144f31cf6c req-37d13f0d-f4b6-457a-b77c-1e61c6f1a533 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:58.988064 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-055e4d75-a675-4c89-9912-4e144f31cf6c req-37d13f0d-f4b6-457a-b77c-1e61c6f1a533 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:59.000470 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-055e4d75-a675-4c89-9912-4e144f31cf6c req-37d13f0d-f4b6-457a-b77c-1e61c6f1a533 service nova] Creating event network-vif-deleted:778fd61a-2cb6-43b5-ad14-c9a69f32bf7c for instance 6b37dd24-5a6e-4898-8247-8e00786088ea on hv-cinder-84456 Oct 03 12:56:59.005550 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-055e4d75-a675-4c89-9912-4e144f31cf6c req-37d13f0d-f4b6-457a-b77c-1e61c6f1a533 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032666 Oct 03 12:56:59.006295 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 408/816] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:56:59.894177 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0ae5e664-ac1c-4d3c-b9a9-4a7d34108f48 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:56:59.894804 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-0ae5e664-ac1c-4d3c-b9a9-4a7d34108f48 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:56:59.902083 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ae5e664-ac1c-4d3c-b9a9-4a7d34108f48 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:59.902586 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ae5e664-ac1c-4d3c-b9a9-4a7d34108f48 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:59.903184 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ae5e664-ac1c-4d3c-b9a9-4a7d34108f48 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:59.904008 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ae5e664-ac1c-4d3c-b9a9-4a7d34108f48 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:59.904476 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ae5e664-ac1c-4d3c-b9a9-4a7d34108f48 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:59.904991 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ae5e664-ac1c-4d3c-b9a9-4a7d34108f48 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:59.939454 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ae5e664-ac1c-4d3c-b9a9-4a7d34108f48 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:56:59.939944 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ae5e664-ac1c-4d3c-b9a9-4a7d34108f48 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:56:59.940490 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0ae5e664-ac1c-4d3c-b9a9-4a7d34108f48 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:56:59.940905 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-0ae5e664-ac1c-4d3c-b9a9-4a7d34108f48 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lazy-loading 'fault' on Instance uuid 6b37dd24-5a6e-4898-8247-8e00786088ea {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:56:59.984385 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0ae5e664-ac1c-4d3c-b9a9-4a7d34108f48 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:59.994480 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0ae5e664-ac1c-4d3c-b9a9-4a7d34108f48 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:59.996661 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0ae5e664-ac1c-4d3c-b9a9-4a7d34108f48 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676b2a6bbf6e4df1b47dba2a9b8e8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e20f793bd0b46a59df730183818d9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:56:59.998129 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-0ae5e664-ac1c-4d3c-b9a9-4a7d34108f48 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 200 len: 1371 microversion: 2.20 time: 0.107907 Oct 03 12:56:59.999129 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 409/817] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:56:59 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 12:57:01.029639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bafa2b1a-3c84-440c-a21b-b610ed5b29b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:01.030453 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-bafa2b1a-3c84-440c-a21b-b610ed5b29b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:01.038400 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bafa2b1a-3c84-440c-a21b-b610ed5b29b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:01.039004 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bafa2b1a-3c84-440c-a21b-b610ed5b29b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:01.040200 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bafa2b1a-3c84-440c-a21b-b610ed5b29b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:01.040987 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bafa2b1a-3c84-440c-a21b-b610ed5b29b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:01.041544 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bafa2b1a-3c84-440c-a21b-b610ed5b29b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:01.042038 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bafa2b1a-3c84-440c-a21b-b610ed5b29b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:01.057824 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-bafa2b1a-3c84-440c-a21b-b610ed5b29b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] HTTP exception thrown: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bafa2b1a-3c84-440c-a21b-b610ed5b29b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Request method failure captured: Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea HTTP/1.1 Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtpqN0A1AScPSBypLI-JbH0UDLrhASTks7mvtLawNlsOidm0hdjGz2a-QOjMg40cwaPF86268eigWpbKpq4Y_quVTfJ9vogC3Ouk0aQAOfC09_oM1yy3-0LqPUI270PdBJycSQZ7skVRHDVt0p-ftPVnlBPABbDN6WxCNFZiknV5UGA Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: 0e20f793bd0b46a59df730183818d9f8 Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 12:57:01.059758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 12:57:01.061504 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:57:01.061504 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:57:01.061504 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: 0e20f793bd0b46a59df730183818d9f8 Oct 03 12:57:01.061504 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:57:01.061504 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-AttachVolumeShelveTestJSON-1471209770-project Oct 03 12:57:01.061504 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 12:57:01.061504 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 12:57:01.061504 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: 676b2a6bbf6e4df1b47dba2a9b8e8862 Oct 03 12:57:01.061504 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1471209770-project Oct 03 12:57:01.061504 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 12:57:01.061504 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. Oct 03 12:57:01.061504 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': '6b37dd24-5a6e-4898-8247-8e00786088ea'} Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:57:01.062387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. Oct 03 12:57:01.063810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:57:01.064952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bafa2b1a-3c84-440c-a21b-b610ed5b29b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Returning 404 to user: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:57:01.064952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-bafa2b1a-3c84-440c-a21b-b610ed5b29b2 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 404 len: 111 microversion: 2.20 time: 0.036700 Oct 03 12:57:01.064952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 409/818] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:57:01 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 12:57:01.070335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e581e127-bcc2-470f-b239-e08a1713cdf9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '.version_select at 0x7fc73bfc53a0>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:01.160165 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e581e127-bcc2-470f-b239-e08a1713cdf9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1569201522" status: 204 len: 0 microversion: 2.20 time: 0.093653 Oct 03 12:57:01.160747 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 410/819] 10.222.0.33 () {60 vars in 1262 bytes} [Mon Oct 3 12:57:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1569201522 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 12:57:03.193357 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9a77b03f-0f84-4c15-8e71-13206bf71870 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:03.193948 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-9a77b03f-0f84-4c15-8e71-13206bf71870 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:03.201434 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9a77b03f-0f84-4c15-8e71-13206bf71870 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:03.202001 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9a77b03f-0f84-4c15-8e71-13206bf71870 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:03.202505 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9a77b03f-0f84-4c15-8e71-13206bf71870 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:03.203345 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9a77b03f-0f84-4c15-8e71-13206bf71870 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:03.203893 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9a77b03f-0f84-4c15-8e71-13206bf71870 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:03.204428 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9a77b03f-0f84-4c15-8e71-13206bf71870 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:03.219897 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-9a77b03f-0f84-4c15-8e71-13206bf71870 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] HTTP exception thrown: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9a77b03f-0f84-4c15-8e71-13206bf71870 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Request method failure captured: Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: DELETE /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea HTTP/1.1 Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtpqN0A1AScPSBypLI-JbH0UDLrhASTks7mvtLawNlsOidm0hdjGz2a-QOjMg40cwaPF86268eigWpbKpq4Y_quVTfJ9vogC3Ouk0aQAOfC09_oM1yy3-0LqPUI270PdBJycSQZ7skVRHDVt0p-ftPVnlBPABbDN6WxCNFZiknV5UGA Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: 0e20f793bd0b46a59df730183818d9f8 Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 12:57:03.221738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 12:57:03.223436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:57:03.223436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:57:03.223436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: 0e20f793bd0b46a59df730183818d9f8 Oct 03 12:57:03.223436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:57:03.223436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-AttachVolumeShelveTestJSON-1471209770-project Oct 03 12:57:03.223436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 12:57:03.223436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 12:57:03.223436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: 676b2a6bbf6e4df1b47dba2a9b8e8862 Oct 03 12:57:03.223436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1471209770-project Oct 03 12:57:03.223436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 12:57:03.223436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. Oct 03 12:57:03.223436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': '6b37dd24-5a6e-4898-8247-8e00786088ea'} Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:57:03.224347 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. Oct 03 12:57:03.225549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:57:03.227389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9a77b03f-0f84-4c15-8e71-13206bf71870 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Returning 404 to user: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:57:03.227389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-9a77b03f-0f84-4c15-8e71-13206bf71870 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 404 len: 111 microversion: 2.20 time: 0.034585 Oct 03 12:57:03.227389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 410/820] 10.222.0.33 () {60 vars in 1280 bytes} [Mon Oct 3 12:57:03 2022] DELETE /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 03 12:57:03.233183 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-142b033d-bce4-465e-93a6-7891090e64b1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:03.233800 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-142b033d-bce4-465e-93a6-7891090e64b1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 6b37dd24-5a6e-4898-8247-8e00786088ea] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:03.242231 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-142b033d-bce4-465e-93a6-7891090e64b1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:03.243424 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-142b033d-bce4-465e-93a6-7891090e64b1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:03.243875 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-142b033d-bce4-465e-93a6-7891090e64b1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:03.244592 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-142b033d-bce4-465e-93a6-7891090e64b1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:03.245053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-142b033d-bce4-465e-93a6-7891090e64b1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:03.245484 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-142b033d-bce4-465e-93a6-7891090e64b1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:03.258894 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-142b033d-bce4-465e-93a6-7891090e64b1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] HTTP exception thrown: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-142b033d-bce4-465e-93a6-7891090e64b1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Request method failure captured: Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea HTTP/1.1 Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtpqN0A1AScPSBypLI-JbH0UDLrhASTks7mvtLawNlsOidm0hdjGz2a-QOjMg40cwaPF86268eigWpbKpq4Y_quVTfJ9vogC3Ouk0aQAOfC09_oM1yy3-0LqPUI270PdBJycSQZ7skVRHDVt0p-ftPVnlBPABbDN6WxCNFZiknV5UGA Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 0e20f793bd0b46a59df730183818d9f8 Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:57:03.260564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:57:03.262210 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:57:03.262210 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:57:03.262210 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 0e20f793bd0b46a59df730183818d9f8 Oct 03 12:57:03.262210 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:57:03.262210 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-AttachVolumeShelveTestJSON-1471209770-project Oct 03 12:57:03.262210 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:57:03.262210 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:57:03.262210 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 676b2a6bbf6e4df1b47dba2a9b8e8862 Oct 03 12:57:03.262210 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1471209770-project Oct 03 12:57:03.262210 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:57:03.262210 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. Oct 03 12:57:03.262210 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': '6b37dd24-5a6e-4898-8247-8e00786088ea'} Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:57:03.263099 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. Oct 03 12:57:03.264433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:57:03.265530 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-142b033d-bce4-465e-93a6-7891090e64b1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Returning 404 to user: Instance 6b37dd24-5a6e-4898-8247-8e00786088ea could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:57:03.265530 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-142b033d-bce4-465e-93a6-7891090e64b1 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea" status: 404 len: 111 microversion: 2.20 time: 0.033171 Oct 03 12:57:03.265530 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 411/821] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:57:03 2022] GET /compute/v2.1/servers/6b37dd24-5a6e-4898-8247-8e00786088ea => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 12:57:04.545041 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c07a6bce-c171-460b-abe5-04ec100ac1f9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:04.545550 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-c07a6bce-c171-460b-abe5-04ec100ac1f9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:04.552003 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c07a6bce-c171-460b-abe5-04ec100ac1f9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:04.553270 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c07a6bce-c171-460b-abe5-04ec100ac1f9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:04.553270 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c07a6bce-c171-460b-abe5-04ec100ac1f9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:04.553599 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c07a6bce-c171-460b-abe5-04ec100ac1f9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:04.554055 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c07a6bce-c171-460b-abe5-04ec100ac1f9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:04.554484 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c07a6bce-c171-460b-abe5-04ec100ac1f9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:04.568576 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-c07a6bce-c171-460b-abe5-04ec100ac1f9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] HTTP exception thrown: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c07a6bce-c171-460b-abe5-04ec100ac1f9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Request method failure captured: Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: DELETE /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a HTTP/1.1 Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtpqN0A1AScPSBypLI-JbH0UDLrhASTks7mvtLawNlsOidm0hdjGz2a-QOjMg40cwaPF86268eigWpbKpq4Y_quVTfJ9vogC3Ouk0aQAOfC09_oM1yy3-0LqPUI270PdBJycSQZ7skVRHDVt0p-ftPVnlBPABbDN6WxCNFZiknV5UGA Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: 0e20f793bd0b46a59df730183818d9f8 Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 12:57:04.570106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 12:57:04.572748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:57:04.572748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:57:04.572748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: 0e20f793bd0b46a59df730183818d9f8 Oct 03 12:57:04.572748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:57:04.572748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-AttachVolumeShelveTestJSON-1471209770-project Oct 03 12:57:04.572748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 12:57:04.572748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 12:57:04.572748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: 676b2a6bbf6e4df1b47dba2a9b8e8862 Oct 03 12:57:04.572748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1471209770-project Oct 03 12:57:04.572748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 12:57:04.572748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. Oct 03 12:57:04.572748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': '54982238-81ba-4d23-b642-e3a37f778b4a'} Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:57:04.573756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. Oct 03 12:57:04.575294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:57:04.577156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c07a6bce-c171-460b-abe5-04ec100ac1f9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Returning 404 to user: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:57:04.577156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c07a6bce-c171-460b-abe5-04ec100ac1f9 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "DELETE /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 404 len: 111 microversion: 2.20 time: 0.031540 Oct 03 12:57:04.577156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 411/822] 10.222.0.33 () {60 vars in 1280 bytes} [Mon Oct 3 12:57:04 2022] DELETE /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 12:57:04.583572 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c70e1139-e3ac-4b55-b5b4-3e965ac1e798 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:04.587677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c70e1139-e3ac-4b55-b5b4-3e965ac1e798 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] [instance: 54982238-81ba-4d23-b642-e3a37f778b4a] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:04.591862 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c70e1139-e3ac-4b55-b5b4-3e965ac1e798 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:04.592403 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c70e1139-e3ac-4b55-b5b4-3e965ac1e798 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:04.593004 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c70e1139-e3ac-4b55-b5b4-3e965ac1e798 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:04.593859 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c70e1139-e3ac-4b55-b5b4-3e965ac1e798 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:04.594474 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c70e1139-e3ac-4b55-b5b4-3e965ac1e798 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:04.594999 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c70e1139-e3ac-4b55-b5b4-3e965ac1e798 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:04.611228 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-c70e1139-e3ac-4b55-b5b4-3e965ac1e798 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] HTTP exception thrown: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c70e1139-e3ac-4b55-b5b4-3e965ac1e798 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Request method failure captured: Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a HTTP/1.1 Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtpqN0A1AScPSBypLI-JbH0UDLrhASTks7mvtLawNlsOidm0hdjGz2a-QOjMg40cwaPF86268eigWpbKpq4Y_quVTfJ9vogC3Ouk0aQAOfC09_oM1yy3-0LqPUI270PdBJycSQZ7skVRHDVt0p-ftPVnlBPABbDN6WxCNFZiknV5UGA Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 0e20f793bd0b46a59df730183818d9f8 Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:57:04.613048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:57:04.614815 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e20f793bd0b46a59df730183818d9f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:57:04.614815 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:57:04.614815 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 0e20f793bd0b46a59df730183818d9f8 Oct 03 12:57:04.614815 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1471209770 Oct 03 12:57:04.614815 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-AttachVolumeShelveTestJSON-1471209770-project Oct 03 12:57:04.614815 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:57:04.614815 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:57:04.614815 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 676b2a6bbf6e4df1b47dba2a9b8e8862 Oct 03 12:57:04.614815 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1471209770-project Oct 03 12:57:04.614815 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:57:04.614815 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. Oct 03 12:57:04.614815 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': '54982238-81ba-4d23-b642-e3a37f778b4a'} Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:57:04.615842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. Oct 03 12:57:04.617372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:57:04.619860 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c70e1139-e3ac-4b55-b5b4-3e965ac1e798 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] Returning 404 to user: Instance 54982238-81ba-4d23-b642-e3a37f778b4a could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:57:04.619860 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c70e1139-e3ac-4b55-b5b4-3e965ac1e798 tempest-AttachVolumeShelveTestJSON-1471209770 tempest-AttachVolumeShelveTestJSON-1471209770-project] 10.222.0.33 "GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a" status: 404 len: 111 microversion: 2.20 time: 0.036008 Oct 03 12:57:04.619860 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 412/823] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 12:57:04 2022] GET /compute/v2.1/servers/54982238-81ba-4d23-b642-e3a37f778b4a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 03 12:57:14.410781 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c0399338-a55b-46d1-8903-32db5178fd3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:14.411465 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-c0399338-a55b-46d1-8903-32db5178fd3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:14.420124 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c0399338-a55b-46d1-8903-32db5178fd3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:14.420608 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c0399338-a55b-46d1-8903-32db5178fd3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:14.421249 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c0399338-a55b-46d1-8903-32db5178fd3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:14.421940 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c0399338-a55b-46d1-8903-32db5178fd3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:14.422394 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c0399338-a55b-46d1-8903-32db5178fd3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:14.422821 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c0399338-a55b-46d1-8903-32db5178fd3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:14.452112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c0399338-a55b-46d1-8903-32db5178fd3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286/ips" status: 200 len: 150 microversion: 2.1 time: 0.046684 Oct 03 12:57:14.452668 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 412/824] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 12:57:14 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:57:16.160814 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-fd2a82a5-c899-425b-b59a-7fb5fcd521bb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "430d8811-49d2-4e68-8bd2-7e62b004613e"}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:57:16.163194 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-fd2a82a5-c899-425b-b59a-7fb5fcd521bb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:16.166237 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:57:16.167025 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=30 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:57:16.171522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd2a82a5-c899-425b-b59a-7fb5fcd521bb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:16.172000 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd2a82a5-c899-425b-b59a-7fb5fcd521bb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:16.172443 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd2a82a5-c899-425b-b59a-7fb5fcd521bb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:16.173136 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd2a82a5-c899-425b-b59a-7fb5fcd521bb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:16.173595 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd2a82a5-c899-425b-b59a-7fb5fcd521bb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:16.174019 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fd2a82a5-c899-425b-b59a-7fb5fcd521bb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:18.830149 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-fd2a82a5-c899-425b-b59a-7fb5fcd521bb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "POST /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.673042 Oct 03 12:57:18.830867 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 413/825] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 12:57:16 2022] POST /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286/os-volume_attachments => generated 194 bytes in 2675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:57:26.373915 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c30f0191-09ee-47c7-a336-714e54fbf1ec tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Action: 'create', calling method: .version_select at 0x7fc743a0e310>, body: {"keypair": {"name": "tempest-keypair-303812126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwVkZaO3lW4WzcgfSBMxrJzu6e4xbG6r+5Mq83BODV8WVW8RHMWZS+2HMDSn/QTyScAURMEF10LrswzhrkIqxlZVUC5P6e37Klqjk0paq2/iFzfCNadGVTPp7tL1vfJeQ=="}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:57:26.379823 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:57:26.380487 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:57:26.392806 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-c30f0191-09ee-47c7-a336-714e54fbf1ec tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Getting quotas for project 484522301976426dae50e64c141c727e. Resources: {'key_pairs'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:57:26.396763 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-c30f0191-09ee-47c7-a336-714e54fbf1ec tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Getting quotas for user 5e29a4c0276247c286cff3eed5a1253a and project 484522301976426dae50e64c141c727e. Resources: {'key_pairs'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:57:26.498178 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c30f0191-09ee-47c7-a336-714e54fbf1ec tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128035 Oct 03 12:57:26.498771 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 413/826] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 12:57:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:57:28.625366 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-352613376", "imageRef": "9d585789-e496-433d-b311-70ec7ceffd99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c116e69-b6ec-41cd-b2b6-637e304e9d46"}], "security_groups": [{"name": "tempest-securitygroup--60188054"}], "key_name": "tempest-keypair-303812126", "user_data": "}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:57:28.636645 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:57:28.733008 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.network.neutron [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] validate_networks() for [('1c116e69-b6ec-41cd-b2b6-637e304e9d46', None, None, None, None, None)] {{(pid=127542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:57:28.766024 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:57:29.113671 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Flavor limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:57:29.114104 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Image limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:57:29.114624 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Flavor pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:57:29.115040 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Image pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:57:29.115659 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:57:29.125345 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:29.125835 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:29.126277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:29.127015 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:29.127569 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:29.128005 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:29.145345 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Getting quotas for project 484522301976426dae50e64c141c727e. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:57:29.150203 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Getting quotas for user 5e29a4c0276247c286cff3eed5a1253a and project 484522301976426dae50e64c141c727e. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:57:29.160708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Going to run 1 instances... {{(pid=127542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:57:29.163178 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d585789-e496-433d-b311-70ec7ceffd99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:57:29.310769 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-584d57e9-f238-49d7-a2b4-2e222b299af0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.690324 Oct 03 12:57:29.311442 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 414/827] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:57:28 2022] POST /compute/v2.1/servers => generated 400 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:57:29.323793 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2e3f2bfa-1882-48d8-93bc-37419a792372 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:29.328205 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2e3f2bfa-1882-48d8-93bc-37419a792372 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:29.385998 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-2e3f2bfa-1882-48d8-93bc-37419a792372 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:29.393675 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-2e3f2bfa-1882-48d8-93bc-37419a792372 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1240 microversion: 2.1 time: 0.074952 Oct 03 12:57:29.394327 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 414/828] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:29 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:30.417323 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-36836718-c151-4c36-a60b-d86af3bbc4a9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:30.417954 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-36836718-c151-4c36-a60b-d86af3bbc4a9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:30.424269 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36836718-c151-4c36-a60b-d86af3bbc4a9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:30.426505 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36836718-c151-4c36-a60b-d86af3bbc4a9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:30.426505 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36836718-c151-4c36-a60b-d86af3bbc4a9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:30.426505 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36836718-c151-4c36-a60b-d86af3bbc4a9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:30.426505 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36836718-c151-4c36-a60b-d86af3bbc4a9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:30.426969 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-36836718-c151-4c36-a60b-d86af3bbc4a9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:30.489373 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-36836718-c151-4c36-a60b-d86af3bbc4a9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:30.497915 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-36836718-c151-4c36-a60b-d86af3bbc4a9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1244 microversion: 2.1 time: 0.085173 Oct 03 12:57:30.508010 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 415/829] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:30 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:31.521323 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-18218b7c-123e-4720-94a1-c807fdaae429 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:31.522475 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-18218b7c-123e-4720-94a1-c807fdaae429 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:31.530164 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-18218b7c-123e-4720-94a1-c807fdaae429 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:31.530662 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-18218b7c-123e-4720-94a1-c807fdaae429 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:31.531112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-18218b7c-123e-4720-94a1-c807fdaae429 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:31.531852 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-18218b7c-123e-4720-94a1-c807fdaae429 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:31.532303 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-18218b7c-123e-4720-94a1-c807fdaae429 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:31.532722 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-18218b7c-123e-4720-94a1-c807fdaae429 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:31.595808 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-18218b7c-123e-4720-94a1-c807fdaae429 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:31.603274 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-18218b7c-123e-4720-94a1-c807fdaae429 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1300 microversion: 2.1 time: 0.085870 Oct 03 12:57:31.604476 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 415/830] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:31 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:32.626701 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1dd78674-954d-4e2f-a99f-13d47d63dbb9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:32.627624 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-1dd78674-954d-4e2f-a99f-13d47d63dbb9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:32.633938 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1dd78674-954d-4e2f-a99f-13d47d63dbb9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:32.635960 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1dd78674-954d-4e2f-a99f-13d47d63dbb9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:32.635960 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1dd78674-954d-4e2f-a99f-13d47d63dbb9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:32.636536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1dd78674-954d-4e2f-a99f-13d47d63dbb9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:32.637362 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1dd78674-954d-4e2f-a99f-13d47d63dbb9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:32.637874 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1dd78674-954d-4e2f-a99f-13d47d63dbb9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:32.781210 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-1dd78674-954d-4e2f-a99f-13d47d63dbb9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:32.788852 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-1dd78674-954d-4e2f-a99f-13d47d63dbb9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1364 microversion: 2.1 time: 0.166396 Oct 03 12:57:32.789419 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 416/831] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:32 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:33.454671 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-f6a39b8a-cc67-43a3-962d-33b2c9aab789 req-abfe437c-6423-4fa4-ae3b-29d984e07a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74732bd8-7fb6-4f8c-a46b-d58d6c1f4384", "tag": "dc215a76-62ab-4c80-b3aa-fbe015feab91"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:57:33.464747 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-f6a39b8a-cc67-43a3-962d-33b2c9aab789 req-abfe437c-6423-4fa4-ae3b-29d984e07a0f service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:33.465220 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-f6a39b8a-cc67-43a3-962d-33b2c9aab789 req-abfe437c-6423-4fa4-ae3b-29d984e07a0f service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:33.465650 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-f6a39b8a-cc67-43a3-962d-33b2c9aab789 req-abfe437c-6423-4fa4-ae3b-29d984e07a0f service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:33.476746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-f6a39b8a-cc67-43a3-962d-33b2c9aab789 req-abfe437c-6423-4fa4-ae3b-29d984e07a0f service nova] Creating event network-changed:dc215a76-62ab-4c80-b3aa-fbe015feab91 for instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 on hv-cinder-84456 Oct 03 12:57:33.482558 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-f6a39b8a-cc67-43a3-962d-33b2c9aab789 req-abfe437c-6423-4fa4-ae3b-29d984e07a0f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031871 Oct 03 12:57:33.483155 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 416/832] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:57:33.813300 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d6ffe8e9-6a89-4e27-b07e-2e16565c4b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:33.814335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d6ffe8e9-6a89-4e27-b07e-2e16565c4b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:33.821377 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d6ffe8e9-6a89-4e27-b07e-2e16565c4b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:33.821877 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d6ffe8e9-6a89-4e27-b07e-2e16565c4b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:33.822321 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d6ffe8e9-6a89-4e27-b07e-2e16565c4b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:33.823658 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d6ffe8e9-6a89-4e27-b07e-2e16565c4b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:33.824123 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d6ffe8e9-6a89-4e27-b07e-2e16565c4b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:33.824554 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d6ffe8e9-6a89-4e27-b07e-2e16565c4b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:33.971494 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-d6ffe8e9-6a89-4e27-b07e-2e16565c4b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:33.979809 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d6ffe8e9-6a89-4e27-b07e-2e16565c4b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1364 microversion: 2.1 time: 0.170211 Oct 03 12:57:33.980437 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 417/833] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:33 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:35.002803 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-6ceffaa3-92c1-4867-88d0-d144326e2a41 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:35.003523 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-6ceffaa3-92c1-4867-88d0-d144326e2a41 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:35.010832 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6ceffaa3-92c1-4867-88d0-d144326e2a41 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:35.011337 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6ceffaa3-92c1-4867-88d0-d144326e2a41 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:35.011776 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6ceffaa3-92c1-4867-88d0-d144326e2a41 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:35.015708 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6ceffaa3-92c1-4867-88d0-d144326e2a41 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:35.015708 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6ceffaa3-92c1-4867-88d0-d144326e2a41 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:35.015708 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6ceffaa3-92c1-4867-88d0-d144326e2a41 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:35.153711 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-6ceffaa3-92c1-4867-88d0-d144326e2a41 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:35.161331 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-6ceffaa3-92c1-4867-88d0-d144326e2a41 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1364 microversion: 2.1 time: 0.162792 Oct 03 12:57:35.167217 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 417/834] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:34 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:36.184442 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-358fb2e1-f013-48f7-ac43-816ae575d7f2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:36.185057 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-358fb2e1-f013-48f7-ac43-816ae575d7f2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:36.192100 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-358fb2e1-f013-48f7-ac43-816ae575d7f2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:36.192588 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-358fb2e1-f013-48f7-ac43-816ae575d7f2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:36.193027 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-358fb2e1-f013-48f7-ac43-816ae575d7f2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:36.193722 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-358fb2e1-f013-48f7-ac43-816ae575d7f2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:36.194177 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-358fb2e1-f013-48f7-ac43-816ae575d7f2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:36.194607 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-358fb2e1-f013-48f7-ac43-816ae575d7f2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:36.327579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-358fb2e1-f013-48f7-ac43-816ae575d7f2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:36.335467 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-358fb2e1-f013-48f7-ac43-816ae575d7f2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1364 microversion: 2.1 time: 0.155015 Oct 03 12:57:36.336032 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 418/835] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:36 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:37.357426 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-11c47dae-dab2-484f-a3ea-053e3a462f8d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:37.357971 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-11c47dae-dab2-484f-a3ea-053e3a462f8d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:37.364428 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11c47dae-dab2-484f-a3ea-053e3a462f8d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:37.364913 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11c47dae-dab2-484f-a3ea-053e3a462f8d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:37.365350 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11c47dae-dab2-484f-a3ea-053e3a462f8d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:37.366056 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11c47dae-dab2-484f-a3ea-053e3a462f8d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:37.366774 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11c47dae-dab2-484f-a3ea-053e3a462f8d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:37.367200 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11c47dae-dab2-484f-a3ea-053e3a462f8d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:37.492325 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-11c47dae-dab2-484f-a3ea-053e3a462f8d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:37.500438 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-11c47dae-dab2-484f-a3ea-053e3a462f8d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1364 microversion: 2.1 time: 0.147001 Oct 03 12:57:37.501038 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 418/836] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:37 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:38.522779 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-9d022421-e59f-4191-9751-84888024e08d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:38.523427 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-9d022421-e59f-4191-9751-84888024e08d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:38.530617 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9d022421-e59f-4191-9751-84888024e08d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:38.531102 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9d022421-e59f-4191-9751-84888024e08d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:38.531584 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9d022421-e59f-4191-9751-84888024e08d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:38.532277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9d022421-e59f-4191-9751-84888024e08d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:38.532736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9d022421-e59f-4191-9751-84888024e08d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:38.533166 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9d022421-e59f-4191-9751-84888024e08d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:38.683479 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-9d022421-e59f-4191-9751-84888024e08d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:38.692064 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-9d022421-e59f-4191-9751-84888024e08d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1364 microversion: 2.1 time: 0.173056 Oct 03 12:57:38.692648 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 419/837] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:38 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:39.715948 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-fb9d30d6-4d29-4d09-9ef9-6ec7bd44c757 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:39.716492 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-fb9d30d6-4d29-4d09-9ef9-6ec7bd44c757 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:39.718903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=6 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:57:39.723619 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fb9d30d6-4d29-4d09-9ef9-6ec7bd44c757 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:39.724102 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fb9d30d6-4d29-4d09-9ef9-6ec7bd44c757 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:39.724533 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fb9d30d6-4d29-4d09-9ef9-6ec7bd44c757 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:39.725215 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fb9d30d6-4d29-4d09-9ef9-6ec7bd44c757 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:39.725663 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fb9d30d6-4d29-4d09-9ef9-6ec7bd44c757 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:39.726081 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fb9d30d6-4d29-4d09-9ef9-6ec7bd44c757 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:39.856872 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-fb9d30d6-4d29-4d09-9ef9-6ec7bd44c757 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:39.866077 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-fb9d30d6-4d29-4d09-9ef9-6ec7bd44c757 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1364 microversion: 2.1 time: 0.154427 Oct 03 12:57:39.867415 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 419/838] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:39 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:40.894863 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-56de5c4d-b404-4942-a785-fa8d02efc426 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:40.895513 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-56de5c4d-b404-4942-a785-fa8d02efc426 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:40.897369 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:57:40.898042 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=6 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:57:40.904065 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-56de5c4d-b404-4942-a785-fa8d02efc426 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:40.904619 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-56de5c4d-b404-4942-a785-fa8d02efc426 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:40.905069 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-56de5c4d-b404-4942-a785-fa8d02efc426 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:40.905770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-56de5c4d-b404-4942-a785-fa8d02efc426 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:40.906233 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-56de5c4d-b404-4942-a785-fa8d02efc426 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:40.906668 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-56de5c4d-b404-4942-a785-fa8d02efc426 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:41.032878 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-56de5c4d-b404-4942-a785-fa8d02efc426 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:41.040911 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-56de5c4d-b404-4942-a785-fa8d02efc426 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1364 microversion: 2.1 time: 0.149879 Oct 03 12:57:41.041641 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 420/839] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:40 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:42.065497 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-732b34f8-dad8-413a-a3ca-573047599ae3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:42.065497 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-732b34f8-dad8-413a-a3ca-573047599ae3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:42.072606 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-732b34f8-dad8-413a-a3ca-573047599ae3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:42.073091 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-732b34f8-dad8-413a-a3ca-573047599ae3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:42.073523 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-732b34f8-dad8-413a-a3ca-573047599ae3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:42.074531 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-732b34f8-dad8-413a-a3ca-573047599ae3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:42.074992 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-732b34f8-dad8-413a-a3ca-573047599ae3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:42.075595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-732b34f8-dad8-413a-a3ca-573047599ae3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:42.217628 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-732b34f8-dad8-413a-a3ca-573047599ae3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:42.225262 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-732b34f8-dad8-413a-a3ca-573047599ae3 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1364 microversion: 2.1 time: 0.164332 Oct 03 12:57:42.225833 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 420/840] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:42 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:43.249118 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-89607159-dce3-43af-8d26-0d7c89ae012f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:43.249861 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-89607159-dce3-43af-8d26-0d7c89ae012f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:43.256522 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-89607159-dce3-43af-8d26-0d7c89ae012f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:43.257014 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-89607159-dce3-43af-8d26-0d7c89ae012f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:43.257459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-89607159-dce3-43af-8d26-0d7c89ae012f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:43.258162 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-89607159-dce3-43af-8d26-0d7c89ae012f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:43.258619 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-89607159-dce3-43af-8d26-0d7c89ae012f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:43.259052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-89607159-dce3-43af-8d26-0d7c89ae012f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:43.389862 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-89607159-dce3-43af-8d26-0d7c89ae012f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:43.397558 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-89607159-dce3-43af-8d26-0d7c89ae012f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1364 microversion: 2.1 time: 0.152851 Oct 03 12:57:43.398138 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 421/841] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:43 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:44.420195 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-38bc028a-d7c2-4b04-89af-0302a27d3bfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:44.420754 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-38bc028a-d7c2-4b04-89af-0302a27d3bfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:44.427179 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-38bc028a-d7c2-4b04-89af-0302a27d3bfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:44.427704 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-38bc028a-d7c2-4b04-89af-0302a27d3bfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:44.428142 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-38bc028a-d7c2-4b04-89af-0302a27d3bfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:44.428830 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-38bc028a-d7c2-4b04-89af-0302a27d3bfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:44.429285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-38bc028a-d7c2-4b04-89af-0302a27d3bfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:44.429708 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-38bc028a-d7c2-4b04-89af-0302a27d3bfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:44.557624 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-38bc028a-d7c2-4b04-89af-0302a27d3bfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:44.565730 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-38bc028a-d7c2-4b04-89af-0302a27d3bfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1364 microversion: 2.1 time: 0.149317 Oct 03 12:57:44.566313 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 421/842] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:44 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:45.584339 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-8402fc69-9782-4995-b1f0-6749e4f6b3ec req-3ff6fb23-1526-4611-9308-f499c7907277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74732bd8-7fb6-4f8c-a46b-d58d6c1f4384", "name": "network-vif-plugged", "status": "completed", "tag": "dc215a76-62ab-4c80-b3aa-fbe015feab91"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:57:45.589896 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3ea41289-3c42-4b37-9b42-8e44e7d052d5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:45.590818 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-3ea41289-3c42-4b37-9b42-8e44e7d052d5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:45.595279 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-8402fc69-9782-4995-b1f0-6749e4f6b3ec req-3ff6fb23-1526-4611-9308-f499c7907277 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:45.595912 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-8402fc69-9782-4995-b1f0-6749e4f6b3ec req-3ff6fb23-1526-4611-9308-f499c7907277 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:45.596349 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-8402fc69-9782-4995-b1f0-6749e4f6b3ec req-3ff6fb23-1526-4611-9308-f499c7907277 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:45.597794 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3ea41289-3c42-4b37-9b42-8e44e7d052d5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:45.598278 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3ea41289-3c42-4b37-9b42-8e44e7d052d5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:45.598709 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3ea41289-3c42-4b37-9b42-8e44e7d052d5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:45.599443 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3ea41289-3c42-4b37-9b42-8e44e7d052d5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:45.600016 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3ea41289-3c42-4b37-9b42-8e44e7d052d5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:45.600554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3ea41289-3c42-4b37-9b42-8e44e7d052d5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:45.608023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-8402fc69-9782-4995-b1f0-6749e4f6b3ec req-3ff6fb23-1526-4611-9308-f499c7907277 service nova] Creating event network-vif-plugged:dc215a76-62ab-4c80-b3aa-fbe015feab91 for instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 on hv-cinder-84456 Oct 03 12:57:45.613025 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-8402fc69-9782-4995-b1f0-6749e4f6b3ec req-3ff6fb23-1526-4611-9308-f499c7907277 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032390 Oct 03 12:57:45.616982 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 422/843] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:57:45.735821 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3ea41289-3c42-4b37-9b42-8e44e7d052d5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:45.743729 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-3ea41289-3c42-4b37-9b42-8e44e7d052d5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1364 microversion: 2.1 time: 0.158033 Oct 03 12:57:45.744346 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 422/844] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:45 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:57:46.767529 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-9c927597-ade8-456c-9336-9bc3e7a9b220 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:46.768169 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-9c927597-ade8-456c-9336-9bc3e7a9b220 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:46.774536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9c927597-ade8-456c-9336-9bc3e7a9b220 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:46.775301 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9c927597-ade8-456c-9336-9bc3e7a9b220 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:46.775788 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9c927597-ade8-456c-9336-9bc3e7a9b220 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:46.776487 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9c927597-ade8-456c-9336-9bc3e7a9b220 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:46.777120 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9c927597-ade8-456c-9336-9bc3e7a9b220 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:46.777626 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9c927597-ade8-456c-9336-9bc3e7a9b220 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:46.914395 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-9c927597-ade8-456c-9336-9bc3e7a9b220 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:46.922548 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-9c927597-ade8-456c-9336-9bc3e7a9b220 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1364 microversion: 2.1 time: 0.160255 Oct 03 12:57:46.923133 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 423/845] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:46 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:47.927545 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1787886677", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-745508035", "security_groups": [{"name": "tempest-secgroup-smoke-797083645"}], "block_device_mapping_v2": [{"uuid": "5863f21d-3a2f-4878-9a7d-b331d48bca66", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1ccd52b4-506d-483d-a4e0-802199d3659f"}]}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:57:47.946081 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e1c7a471-b0a8-4996-a953-46042b6ff3ee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:47.946696 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e1c7a471-b0a8-4996-a953-46042b6ff3ee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:47.954011 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e1c7a471-b0a8-4996-a953-46042b6ff3ee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:47.954514 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e1c7a471-b0a8-4996-a953-46042b6ff3ee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:47.955780 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e1c7a471-b0a8-4996-a953-46042b6ff3ee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:47.956735 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e1c7a471-b0a8-4996-a953-46042b6ff3ee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:47.957400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e1c7a471-b0a8-4996-a953-46042b6ff3ee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:47.958694 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e1c7a471-b0a8-4996-a953-46042b6ff3ee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:48.113172 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.network.neutron [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] validate_networks() for [('1ccd52b4-506d-483d-a4e0-802199d3659f', None, None, None, None, None)] {{(pid=127544) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:57:48.164316 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e1c7a471-b0a8-4996-a953-46042b6ff3ee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:48.172724 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e1c7a471-b0a8-4996-a953-46042b6ff3ee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1364 microversion: 2.1 time: 0.230604 Oct 03 12:57:48.173542 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 424/846] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:47 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:57:48.650483 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Flavor limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:57:48.651298 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Image limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:57:48.651810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Flavor pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:57:48.652248 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Image pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:57:48.652664 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:57:48.662199 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:48.662689 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:48.663173 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:48.663950 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:48.664407 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:48.664836 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:48.683531 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Getting quotas for project 38d1778202d041b58934150c6af9685c. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:57:48.688476 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Getting quotas for user 7ffffa27986f461ebc10c23c3c9817f0 and project 38d1778202d041b58934150c6af9685c. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:57:48.750111 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Going to run 1 instances... {{(pid=127544) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:57:48.752358 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5863f21d-3a2f-4878-9a7d-b331d48bca66',volume_size=None,volume_type=None)] {{(pid=127544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:57:49.116867 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-8b9399b8-890b-42d1-ac6d-e8f34a0ce4fc tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.193276 Oct 03 12:57:49.117790 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 423/847] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:57:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:57:49.128833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c77782cf-0190-4bae-a251-b7721bd0744c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:49.129449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c77782cf-0190-4bae-a251-b7721bd0744c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:49.188245 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c77782cf-0190-4bae-a251-b7721bd0744c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:49.198086 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c77782cf-0190-4bae-a251-b7721bd0744c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1094 microversion: 2.1 time: 0.073005 Oct 03 12:57:49.198965 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 425/848] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:49 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:57:49.199981 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-6bbcaac0-a4ab-40b0-975c-c644a1c5cfc8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:49.201496 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-6bbcaac0-a4ab-40b0-975c-c644a1c5cfc8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:49.209100 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6bbcaac0-a4ab-40b0-975c-c644a1c5cfc8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:49.209825 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6bbcaac0-a4ab-40b0-975c-c644a1c5cfc8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:49.211351 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6bbcaac0-a4ab-40b0-975c-c644a1c5cfc8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:49.212262 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6bbcaac0-a4ab-40b0-975c-c644a1c5cfc8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:49.213534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6bbcaac0-a4ab-40b0-975c-c644a1c5cfc8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:49.214437 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6bbcaac0-a4ab-40b0-975c-c644a1c5cfc8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:49.359881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-6bbcaac0-a4ab-40b0-975c-c644a1c5cfc8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:49.367992 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-6bbcaac0-a4ab-40b0-975c-c644a1c5cfc8 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1555 microversion: 2.1 time: 0.173410 Oct 03 12:57:49.372299 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 424/849] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:49 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:49.390210 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-bb575d25-0af5-4596-8180-b00dde12eb3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:49.390714 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-bb575d25-0af5-4596-8180-b00dde12eb3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:49.396652 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bb575d25-0af5-4596-8180-b00dde12eb3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:49.406886 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bb575d25-0af5-4596-8180-b00dde12eb3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:49.406886 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bb575d25-0af5-4596-8180-b00dde12eb3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:49.406886 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bb575d25-0af5-4596-8180-b00dde12eb3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:49.406886 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bb575d25-0af5-4596-8180-b00dde12eb3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:49.407271 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bb575d25-0af5-4596-8180-b00dde12eb3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:49.482184 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-bb575d25-0af5-4596-8180-b00dde12eb3c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095699 Oct 03 12:57:49.482823 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 426/850] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Oct 3 12:57:49 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:57:50.222442 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-15559f58-7512-48b1-8fe2-cf599b7c09d1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:50.223043 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-15559f58-7512-48b1-8fe2-cf599b7c09d1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:50.229921 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-15559f58-7512-48b1-8fe2-cf599b7c09d1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:50.230586 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-15559f58-7512-48b1-8fe2-cf599b7c09d1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:50.234256 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-15559f58-7512-48b1-8fe2-cf599b7c09d1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:50.234256 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-15559f58-7512-48b1-8fe2-cf599b7c09d1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:50.234256 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-15559f58-7512-48b1-8fe2-cf599b7c09d1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:50.234256 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-15559f58-7512-48b1-8fe2-cf599b7c09d1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:50.316348 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-15559f58-7512-48b1-8fe2-cf599b7c09d1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:50.324275 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-15559f58-7512-48b1-8fe2-cf599b7c09d1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1144 microversion: 2.1 time: 0.105991 Oct 03 12:57:50.325662 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 425/851] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:50 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1144 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:50.884496 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-3c57fdd8-9998-4b9b-a959-e978d34617ff req-7c54e1f4-4fed-448a-8b3a-8bdb782de214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74732bd8-7fb6-4f8c-a46b-d58d6c1f4384", "tag": "dc215a76-62ab-4c80-b3aa-fbe015feab91"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:57:50.894458 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-3c57fdd8-9998-4b9b-a959-e978d34617ff req-7c54e1f4-4fed-448a-8b3a-8bdb782de214 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:50.894944 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-3c57fdd8-9998-4b9b-a959-e978d34617ff req-7c54e1f4-4fed-448a-8b3a-8bdb782de214 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:50.895415 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-3c57fdd8-9998-4b9b-a959-e978d34617ff req-7c54e1f4-4fed-448a-8b3a-8bdb782de214 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:50.907070 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-3c57fdd8-9998-4b9b-a959-e978d34617ff req-7c54e1f4-4fed-448a-8b3a-8bdb782de214 service nova] Creating event network-changed:dc215a76-62ab-4c80-b3aa-fbe015feab91 for instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 on hv-cinder-84456 Oct 03 12:57:50.912268 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-3c57fdd8-9998-4b9b-a959-e978d34617ff req-7c54e1f4-4fed-448a-8b3a-8bdb782de214 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031881 Oct 03 12:57:50.912874 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 427/852] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:57:51.349938 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-7dcb59f6-f87e-4c1c-985c-c55d9fef8206 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:51.351345 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-7dcb59f6-f87e-4c1c-985c-c55d9fef8206 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:51.360682 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7dcb59f6-f87e-4c1c-985c-c55d9fef8206 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:51.361450 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7dcb59f6-f87e-4c1c-985c-c55d9fef8206 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:51.362005 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7dcb59f6-f87e-4c1c-985c-c55d9fef8206 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:51.362867 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7dcb59f6-f87e-4c1c-985c-c55d9fef8206 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:51.363575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7dcb59f6-f87e-4c1c-985c-c55d9fef8206 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:51.364112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7dcb59f6-f87e-4c1c-985c-c55d9fef8206 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:51.428607 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7dcb59f6-f87e-4c1c-985c-c55d9fef8206 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:51.436923 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-7dcb59f6-f87e-4c1c-985c-c55d9fef8206 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1192 microversion: 2.1 time: 0.091003 Oct 03 12:57:51.437490 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 426/853] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:51 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:52.461473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-66afd764-6919-474b-92d5-150df94304d6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:52.464239 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-66afd764-6919-474b-92d5-150df94304d6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:52.469279 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-66afd764-6919-474b-92d5-150df94304d6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:52.469859 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-66afd764-6919-474b-92d5-150df94304d6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:52.470297 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-66afd764-6919-474b-92d5-150df94304d6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:52.470988 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-66afd764-6919-474b-92d5-150df94304d6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:52.471505 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-66afd764-6919-474b-92d5-150df94304d6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:52.471931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-66afd764-6919-474b-92d5-150df94304d6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:52.537779 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-66afd764-6919-474b-92d5-150df94304d6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:52.546869 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-66afd764-6919-474b-92d5-150df94304d6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1210 microversion: 2.1 time: 0.090003 Oct 03 12:57:52.547653 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 428/854] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:52 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:57:53.572679 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-5ab96f0d-b3ef-4378-9693-1989f58a28cb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:53.573287 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-5ab96f0d-b3ef-4378-9693-1989f58a28cb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:53.580492 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5ab96f0d-b3ef-4378-9693-1989f58a28cb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:53.580978 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5ab96f0d-b3ef-4378-9693-1989f58a28cb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:53.581624 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5ab96f0d-b3ef-4378-9693-1989f58a28cb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:53.583247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5ab96f0d-b3ef-4378-9693-1989f58a28cb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:53.583731 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5ab96f0d-b3ef-4378-9693-1989f58a28cb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:53.584645 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5ab96f0d-b3ef-4378-9693-1989f58a28cb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:53.600485 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-3ae44c90-6f4d-43fc-8b85-5edd4decdebc req-3e46837c-a6f6-46a3-9632-50a95f19e5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6c4b7a-3b99-4a50-9703-a776b7b6b076", "tag": "c76db3b4-ecf1-4866-ba33-9d3ed7d5947b"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:57:53.616220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-3ae44c90-6f4d-43fc-8b85-5edd4decdebc req-3e46837c-a6f6-46a3-9632-50a95f19e5b0 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:53.618747 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-3ae44c90-6f4d-43fc-8b85-5edd4decdebc req-3e46837c-a6f6-46a3-9632-50a95f19e5b0 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:53.619965 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-3ae44c90-6f4d-43fc-8b85-5edd4decdebc req-3e46837c-a6f6-46a3-9632-50a95f19e5b0 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:53.638102 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-3ae44c90-6f4d-43fc-8b85-5edd4decdebc req-3e46837c-a6f6-46a3-9632-50a95f19e5b0 service nova] Creating event network-changed:c76db3b4-ecf1-4866-ba33-9d3ed7d5947b for instance ee6c4b7a-3b99-4a50-9703-a776b7b6b076 on hv-cinder-84456 Oct 03 12:57:53.643124 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-3ae44c90-6f4d-43fc-8b85-5edd4decdebc req-3e46837c-a6f6-46a3-9632-50a95f19e5b0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047508 Oct 03 12:57:53.643941 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 429/855] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:57:53.745878 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-5ab96f0d-b3ef-4378-9693-1989f58a28cb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:53.754015 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-5ab96f0d-b3ef-4378-9693-1989f58a28cb tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1265 microversion: 2.1 time: 0.185565 Oct 03 12:57:53.755396 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 427/856] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:53 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:54.777349 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-49f67c25-1d95-43a5-b9fd-e0486b828caf tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:54.778096 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-49f67c25-1d95-43a5-b9fd-e0486b828caf tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:54.784284 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-49f67c25-1d95-43a5-b9fd-e0486b828caf tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:54.784765 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-49f67c25-1d95-43a5-b9fd-e0486b828caf tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:54.785200 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-49f67c25-1d95-43a5-b9fd-e0486b828caf tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:54.785913 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-49f67c25-1d95-43a5-b9fd-e0486b828caf tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:54.786371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-49f67c25-1d95-43a5-b9fd-e0486b828caf tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:54.786794 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-49f67c25-1d95-43a5-b9fd-e0486b828caf tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:54.916325 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-49f67c25-1d95-43a5-b9fd-e0486b828caf tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:54.924714 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-49f67c25-1d95-43a5-b9fd-e0486b828caf tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1265 microversion: 2.1 time: 0.152074 Oct 03 12:57:54.925286 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 430/857] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:54 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:55.947106 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d88354b0-8365-4df5-8427-cede8bd96f43 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:55.947785 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d88354b0-8365-4df5-8427-cede8bd96f43 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:55.955082 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d88354b0-8365-4df5-8427-cede8bd96f43 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:55.955605 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d88354b0-8365-4df5-8427-cede8bd96f43 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:55.956041 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d88354b0-8365-4df5-8427-cede8bd96f43 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:55.956731 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d88354b0-8365-4df5-8427-cede8bd96f43 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:55.957189 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d88354b0-8365-4df5-8427-cede8bd96f43 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:55.957620 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d88354b0-8365-4df5-8427-cede8bd96f43 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:56.085093 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d88354b0-8365-4df5-8427-cede8bd96f43 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:56.093070 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d88354b0-8365-4df5-8427-cede8bd96f43 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1265 microversion: 2.1 time: 0.149806 Oct 03 12:57:56.093643 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 428/858] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:55 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:57.115155 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-86c52a52-56d8-4f28-b3da-6b0a0900f29d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:57.115773 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-86c52a52-56d8-4f28-b3da-6b0a0900f29d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:57.123707 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-86c52a52-56d8-4f28-b3da-6b0a0900f29d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:57.124202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-86c52a52-56d8-4f28-b3da-6b0a0900f29d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:57.124641 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-86c52a52-56d8-4f28-b3da-6b0a0900f29d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:57.125344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-86c52a52-56d8-4f28-b3da-6b0a0900f29d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:57.125794 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-86c52a52-56d8-4f28-b3da-6b0a0900f29d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:57.126223 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-86c52a52-56d8-4f28-b3da-6b0a0900f29d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:57.262698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-86c52a52-56d8-4f28-b3da-6b0a0900f29d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:57.270359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-86c52a52-56d8-4f28-b3da-6b0a0900f29d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1265 microversion: 2.1 time: 0.159081 Oct 03 12:57:57.270923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 431/859] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:57 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:58.292812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-f0822a1d-281a-4f35-9dd9-73f409bcc967 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:58.293422 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-f0822a1d-281a-4f35-9dd9-73f409bcc967 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:58.300246 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f0822a1d-281a-4f35-9dd9-73f409bcc967 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:58.300730 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f0822a1d-281a-4f35-9dd9-73f409bcc967 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:58.301164 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f0822a1d-281a-4f35-9dd9-73f409bcc967 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:58.301871 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f0822a1d-281a-4f35-9dd9-73f409bcc967 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:58.302301 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f0822a1d-281a-4f35-9dd9-73f409bcc967 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:58.302744 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f0822a1d-281a-4f35-9dd9-73f409bcc967 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:58.435626 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-f0822a1d-281a-4f35-9dd9-73f409bcc967 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:58.443604 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-f0822a1d-281a-4f35-9dd9-73f409bcc967 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1265 microversion: 2.1 time: 0.154610 Oct 03 12:57:58.444310 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 429/860] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:58 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:57:59.467235 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-938101d7-d8fc-4c81-a0f5-366e7f732465 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:57:59.467875 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-938101d7-d8fc-4c81-a0f5-366e7f732465 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:57:59.470328 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:57:59.471003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:57:59.475645 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-938101d7-d8fc-4c81-a0f5-366e7f732465 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:59.476132 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-938101d7-d8fc-4c81-a0f5-366e7f732465 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:59.476564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-938101d7-d8fc-4c81-a0f5-366e7f732465 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:59.477253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-938101d7-d8fc-4c81-a0f5-366e7f732465 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:57:59.477707 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-938101d7-d8fc-4c81-a0f5-366e7f732465 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:57:59.478130 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-938101d7-d8fc-4c81-a0f5-366e7f732465 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:57:59.482164 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=85 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:57:59.769274 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-938101d7-d8fc-4c81-a0f5-366e7f732465 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:57:59.777089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-938101d7-d8fc-4c81-a0f5-366e7f732465 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1265 microversion: 2.1 time: 0.314294 Oct 03 12:57:59.777682 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 432/861] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:57:59 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1265 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:00.767618 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-f5001983-d6fc-474b-91be-1cb506e30e57 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:00.768439 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-f5001983-d6fc-474b-91be-1cb506e30e57 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:00.770672 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=2 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:58:00.771431 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=6 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:58:00.771646 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-fa37d894-3ace-4d7c-9d91-72d0e93cf9c2 req-3f3d4c5e-4619-4a4a-b764-60cc06b39177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a54301-d1b8-4060-b712-8d707bcfbef5", "tag": "7deec46d-97bb-4a3f-a77b-11832cd2ffe1"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:58:00.773142 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:58:00.779026 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f5001983-d6fc-474b-91be-1cb506e30e57 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:00.779630 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f5001983-d6fc-474b-91be-1cb506e30e57 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:00.780186 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f5001983-d6fc-474b-91be-1cb506e30e57 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:00.780966 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f5001983-d6fc-474b-91be-1cb506e30e57 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:00.781486 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f5001983-d6fc-474b-91be-1cb506e30e57 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:00.782345 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f5001983-d6fc-474b-91be-1cb506e30e57 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:00.783199 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-fa37d894-3ace-4d7c-9d91-72d0e93cf9c2 req-3f3d4c5e-4619-4a4a-b764-60cc06b39177 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:00.783904 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-fa37d894-3ace-4d7c-9d91-72d0e93cf9c2 req-3f3d4c5e-4619-4a4a-b764-60cc06b39177 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:00.784525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-fa37d894-3ace-4d7c-9d91-72d0e93cf9c2 req-3f3d4c5e-4619-4a4a-b764-60cc06b39177 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:00.787637 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=83 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:58:00.796875 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-fa37d894-3ace-4d7c-9d91-72d0e93cf9c2 req-3f3d4c5e-4619-4a4a-b764-60cc06b39177 service nova] Creating event network-changed:7deec46d-97bb-4a3f-a77b-11832cd2ffe1 for instance e3a54301-d1b8-4060-b712-8d707bcfbef5 on hv-cinder-84456 Oct 03 12:58:00.802284 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-fa37d894-3ace-4d7c-9d91-72d0e93cf9c2 req-3f3d4c5e-4619-4a4a-b764-60cc06b39177 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036469 Oct 03 12:58:00.803101 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 433/862] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:58:00.809686 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-15f1fc55-393b-433d-bd9e-899e3c7e50f0 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:00.811026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-15f1fc55-393b-433d-bd9e-899e3c7e50f0 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:00.812348 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-f5001983-d6fc-474b-91be-1cb506e30e57 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Going to try to terminate instance {{(pid=127544) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:58:00.827803 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-15f1fc55-393b-433d-bd9e-899e3c7e50f0 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:00.828310 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-15f1fc55-393b-433d-bd9e-899e3c7e50f0 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:00.828760 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-15f1fc55-393b-433d-bd9e-899e3c7e50f0 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:00.829703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-15f1fc55-393b-433d-bd9e-899e3c7e50f0 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:00.830158 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-15f1fc55-393b-433d-bd9e-899e3c7e50f0 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:00.830591 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-15f1fc55-393b-433d-bd9e-899e3c7e50f0 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:00.993622 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-15f1fc55-393b-433d-bd9e-899e3c7e50f0 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:01.002597 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-15f1fc55-393b-433d-bd9e-899e3c7e50f0 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1265 microversion: 2.1 time: 0.198052 Oct 03 12:58:01.003724 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 434/863] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:00 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:01.186981 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-f5001983-d6fc-474b-91be-1cb506e30e57 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 204 len: 0 microversion: 2.1 time: 0.424295 Oct 03 12:58:01.187699 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 430/864] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:58:00 2022] DELETE /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:58:01.196424 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4b22280e-67bf-4e64-89ba-891925ebdd0e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:01.197380 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-4b22280e-67bf-4e64-89ba-891925ebdd0e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:01.204262 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b22280e-67bf-4e64-89ba-891925ebdd0e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:01.205325 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b22280e-67bf-4e64-89ba-891925ebdd0e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:01.206067 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b22280e-67bf-4e64-89ba-891925ebdd0e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:01.206782 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b22280e-67bf-4e64-89ba-891925ebdd0e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:01.207243 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b22280e-67bf-4e64-89ba-891925ebdd0e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:01.207879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b22280e-67bf-4e64-89ba-891925ebdd0e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:01.351962 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4b22280e-67bf-4e64-89ba-891925ebdd0e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:01.361209 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-4b22280e-67bf-4e64-89ba-891925ebdd0e tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1569 microversion: 2.1 time: 0.169335 Oct 03 12:58:01.361793 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 435/865] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:01 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:02.027482 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-07be87b8-9206-497c-8024-e08878d6f80f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:02.028818 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-07be87b8-9206-497c-8024-e08878d6f80f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:02.035727 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-07be87b8-9206-497c-8024-e08878d6f80f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:02.036200 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-07be87b8-9206-497c-8024-e08878d6f80f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:02.036636 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-07be87b8-9206-497c-8024-e08878d6f80f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:02.037334 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-07be87b8-9206-497c-8024-e08878d6f80f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:02.037788 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-07be87b8-9206-497c-8024-e08878d6f80f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:02.038212 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-07be87b8-9206-497c-8024-e08878d6f80f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:02.173377 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-07be87b8-9206-497c-8024-e08878d6f80f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:02.181446 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-07be87b8-9206-497c-8024-e08878d6f80f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1265 microversion: 2.1 time: 0.158967 Oct 03 12:58:02.182020 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 431/866] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:02 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:02.384971 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-95710c75-143c-4e6f-b7fc-934b0928e7f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:02.386278 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-95710c75-143c-4e6f-b7fc-934b0928e7f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:02.393224 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-95710c75-143c-4e6f-b7fc-934b0928e7f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:02.399586 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-95710c75-143c-4e6f-b7fc-934b0928e7f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:02.399586 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-95710c75-143c-4e6f-b7fc-934b0928e7f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:02.399586 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-95710c75-143c-4e6f-b7fc-934b0928e7f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:02.399586 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-95710c75-143c-4e6f-b7fc-934b0928e7f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:02.400018 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-95710c75-143c-4e6f-b7fc-934b0928e7f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:02.537266 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-95710c75-143c-4e6f-b7fc-934b0928e7f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:02.545537 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-95710c75-143c-4e6f-b7fc-934b0928e7f8 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1569 microversion: 2.1 time: 0.164392 Oct 03 12:58:02.546145 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 436/867] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:02 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:03.205073 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b3b1d951-ced1-4010-93c1-5a967f169de1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:03.205811 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-b3b1d951-ced1-4010-93c1-5a967f169de1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:03.212516 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b3b1d951-ced1-4010-93c1-5a967f169de1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:03.213355 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b3b1d951-ced1-4010-93c1-5a967f169de1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:03.213792 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b3b1d951-ced1-4010-93c1-5a967f169de1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:03.214530 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b3b1d951-ced1-4010-93c1-5a967f169de1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:03.214982 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b3b1d951-ced1-4010-93c1-5a967f169de1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:03.215432 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b3b1d951-ced1-4010-93c1-5a967f169de1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:03.368817 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-b3b1d951-ced1-4010-93c1-5a967f169de1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:03.379520 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-b3b1d951-ced1-4010-93c1-5a967f169de1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1265 microversion: 2.1 time: 0.178518 Oct 03 12:58:03.380116 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 432/868] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:03 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:03.392299 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-01b7e73d-12d3-4023-a50e-fa32073839c3 req-4b0a75e4-480e-4d8c-bc18-3cc0db9fe5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a54301-d1b8-4060-b712-8d707bcfbef5", "name": "network-vif-deleted", "tag": "7deec46d-97bb-4a3f-a77b-11832cd2ffe1"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:58:03.402655 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-01b7e73d-12d3-4023-a50e-fa32073839c3 req-4b0a75e4-480e-4d8c-bc18-3cc0db9fe5a5 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:03.403141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-01b7e73d-12d3-4023-a50e-fa32073839c3 req-4b0a75e4-480e-4d8c-bc18-3cc0db9fe5a5 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:03.404460 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-01b7e73d-12d3-4023-a50e-fa32073839c3 req-4b0a75e4-480e-4d8c-bc18-3cc0db9fe5a5 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:03.415460 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-01b7e73d-12d3-4023-a50e-fa32073839c3 req-4b0a75e4-480e-4d8c-bc18-3cc0db9fe5a5 service nova] Creating event network-vif-deleted:7deec46d-97bb-4a3f-a77b-11832cd2ffe1 for instance e3a54301-d1b8-4060-b712-8d707bcfbef5 on hv-cinder-84456 Oct 03 12:58:03.421105 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-01b7e73d-12d3-4023-a50e-fa32073839c3 req-4b0a75e4-480e-4d8c-bc18-3cc0db9fe5a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032935 Oct 03 12:58:03.421673 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 437/869] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:58:03.570814 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c37673c3-6d26-40e0-9f3c-a8df5766a949 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:03.571158 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-c37673c3-6d26-40e0-9f3c-a8df5766a949 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:03.577452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c37673c3-6d26-40e0-9f3c-a8df5766a949 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:03.578190 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c37673c3-6d26-40e0-9f3c-a8df5766a949 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:03.578624 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c37673c3-6d26-40e0-9f3c-a8df5766a949 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:03.579363 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c37673c3-6d26-40e0-9f3c-a8df5766a949 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:03.579868 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c37673c3-6d26-40e0-9f3c-a8df5766a949 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:03.580291 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c37673c3-6d26-40e0-9f3c-a8df5766a949 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:03.646423 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c37673c3-6d26-40e0-9f3c-a8df5766a949 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:03.654901 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c37673c3-6d26-40e0-9f3c-a8df5766a949 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1220 microversion: 2.1 time: 0.088786 Oct 03 12:58:03.655695 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 433/870] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:03 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:03.920063 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-6d86443a-24d6-4e78-bf24-d83521a0d31a req-968bfa32-0c36-4188-954a-cbd60c18688b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6c4b7a-3b99-4a50-9703-a776b7b6b076", "name": "network-vif-plugged", "status": "completed", "tag": "c76db3b4-ecf1-4866-ba33-9d3ed7d5947b"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:58:03.929400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-6d86443a-24d6-4e78-bf24-d83521a0d31a req-968bfa32-0c36-4188-954a-cbd60c18688b service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:03.929882 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-6d86443a-24d6-4e78-bf24-d83521a0d31a req-968bfa32-0c36-4188-954a-cbd60c18688b service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:03.930316 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-6d86443a-24d6-4e78-bf24-d83521a0d31a req-968bfa32-0c36-4188-954a-cbd60c18688b service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:03.941511 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-6d86443a-24d6-4e78-bf24-d83521a0d31a req-968bfa32-0c36-4188-954a-cbd60c18688b service nova] Creating event network-vif-plugged:c76db3b4-ecf1-4866-ba33-9d3ed7d5947b for instance ee6c4b7a-3b99-4a50-9703-a776b7b6b076 on hv-cinder-84456 Oct 03 12:58:03.946344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-6d86443a-24d6-4e78-bf24-d83521a0d31a req-968bfa32-0c36-4188-954a-cbd60c18688b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031644 Oct 03 12:58:03.946952 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 438/871] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:58:04.403123 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-1cb5edad-80ff-4f01-8e49-32f0b3ed211b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:04.404388 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-1cb5edad-80ff-4f01-8e49-32f0b3ed211b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:04.410723 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cb5edad-80ff-4f01-8e49-32f0b3ed211b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:04.411204 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cb5edad-80ff-4f01-8e49-32f0b3ed211b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:04.411693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cb5edad-80ff-4f01-8e49-32f0b3ed211b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:04.412381 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cb5edad-80ff-4f01-8e49-32f0b3ed211b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:04.412828 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cb5edad-80ff-4f01-8e49-32f0b3ed211b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:04.413249 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1cb5edad-80ff-4f01-8e49-32f0b3ed211b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:04.605652 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-1cb5edad-80ff-4f01-8e49-32f0b3ed211b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:04.616433 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-1cb5edad-80ff-4f01-8e49-32f0b3ed211b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1265 microversion: 2.1 time: 0.216927 Oct 03 12:58:04.626025 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 434/872] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:04 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:04.679701 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-348feb7b-14d7-4928-8ca4-155e957da3d2 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:04.680403 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-348feb7b-14d7-4928-8ca4-155e957da3d2 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:04.687377 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-348feb7b-14d7-4928-8ca4-155e957da3d2 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:04.687930 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-348feb7b-14d7-4928-8ca4-155e957da3d2 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:04.688290 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-348feb7b-14d7-4928-8ca4-155e957da3d2 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:04.688990 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-348feb7b-14d7-4928-8ca4-155e957da3d2 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:04.689442 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-348feb7b-14d7-4928-8ca4-155e957da3d2 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:04.689867 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-348feb7b-14d7-4928-8ca4-155e957da3d2 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:04.721713 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-348feb7b-14d7-4928-8ca4-155e957da3d2 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:04.722201 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-348feb7b-14d7-4928-8ca4-155e957da3d2 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:04.722636 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-348feb7b-14d7-4928-8ca4-155e957da3d2 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:04.723079 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-348feb7b-14d7-4928-8ca4-155e957da3d2 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lazy-loading 'fault' on Instance uuid e3a54301-d1b8-4060-b712-8d707bcfbef5 {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:58:04.767893 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-348feb7b-14d7-4928-8ca4-155e957da3d2 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafb4a06c49d47cdb970e3f9e08a2543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a284bf10ff47d6bc58de80f92c164a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:04.777203 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-348feb7b-14d7-4928-8ca4-155e957da3d2 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 200 len: 1225 microversion: 2.1 time: 0.102289 Oct 03 12:58:04.777771 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 439/873] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:04 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:05.641335 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c178dd7c-ce78-48a4-a902-b4b16cfe9f62 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:05.641986 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-c178dd7c-ce78-48a4-a902-b4b16cfe9f62 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:05.648914 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c178dd7c-ce78-48a4-a902-b4b16cfe9f62 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:05.649522 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c178dd7c-ce78-48a4-a902-b4b16cfe9f62 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:05.650021 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c178dd7c-ce78-48a4-a902-b4b16cfe9f62 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:05.650762 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c178dd7c-ce78-48a4-a902-b4b16cfe9f62 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:05.651218 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c178dd7c-ce78-48a4-a902-b4b16cfe9f62 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:05.651716 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c178dd7c-ce78-48a4-a902-b4b16cfe9f62 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:05.801911 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e768f7b7-6cc5-4eea-ad0a-74f75973a879 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:05.802541 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e768f7b7-6cc5-4eea-ad0a-74f75973a879 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] [instance: e3a54301-d1b8-4060-b712-8d707bcfbef5] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:05.808951 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e768f7b7-6cc5-4eea-ad0a-74f75973a879 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:05.810024 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e768f7b7-6cc5-4eea-ad0a-74f75973a879 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:05.810811 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e768f7b7-6cc5-4eea-ad0a-74f75973a879 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:05.814557 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e768f7b7-6cc5-4eea-ad0a-74f75973a879 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:05.814557 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e768f7b7-6cc5-4eea-ad0a-74f75973a879 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:05.814557 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e768f7b7-6cc5-4eea-ad0a-74f75973a879 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:05.828023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-e768f7b7-6cc5-4eea-ad0a-74f75973a879 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] HTTP exception thrown: Instance e3a54301-d1b8-4060-b712-8d707bcfbef5 could not be found. Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e768f7b7-6cc5-4eea-ad0a-74f75973a879 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Request method failure captured: Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 HTTP/1.1 Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtswFooH_bx-1DPlyaJAQnO-i8LkPTW9LCNeMxEbZyKaMLleBBrBhyu3xlXrtBzryYo9B9whZPE_5nCD2C3PtynI1Kfa6E4ciw2CdYsBjbmB4SLqdK4kHp-0nRH4XPiU_JdAteDWgB3Qnporjg2S_1GnwAwIGPLvLU7SLqf_nHqA2o8 Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 06a284bf10ff47d6bc58de80f92c164a Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-TestShelveInstance-883453511 Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:58:05.829715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:58:05.831170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_06a284bf10ff47d6bc58de80f92c164a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/06a284bf10ff47d6bc58de80f92c164a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/06a284bf10ff47d6bc58de80f92c164a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/06a284bf10ff47d6bc58de80f92c164a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:58:05.831170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-TestShelveInstance-883453511 Oct 03 12:58:05.831170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 06a284bf10ff47d6bc58de80f92c164a Oct 03 12:58:05.831170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-TestShelveInstance-883453511 Oct 03 12:58:05.831170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-TestShelveInstance-883453511-project Oct 03 12:58:05.831170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:58:05.831170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:58:05.831170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: bafb4a06c49d47cdb970e3f9e08a2543 Oct 03 12:58:05.831170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-TestShelveInstance-883453511-project Oct 03 12:58:05.831170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:58:05.831170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance e3a54301-d1b8-4060-b712-8d707bcfbef5 could not be found. Oct 03 12:58:05.831170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': 'e3a54301-d1b8-4060-b712-8d707bcfbef5'} Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a54301-d1b8-4060-b712-8d707bcfbef5 could not be found. Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:58:05.832344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a54301-d1b8-4060-b712-8d707bcfbef5 could not be found. Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a54301-d1b8-4060-b712-8d707bcfbef5 could not be found. Oct 03 12:58:05.833732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:58:05.834858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e768f7b7-6cc5-4eea-ad0a-74f75973a879 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Returning 404 to user: Instance e3a54301-d1b8-4060-b712-8d707bcfbef5 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:58:05.834858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e768f7b7-6cc5-4eea-ad0a-74f75973a879 tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5" status: 404 len: 111 microversion: 2.1 time: 0.033517 Oct 03 12:58:05.834858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 440/874] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:05 2022] GET /compute/v2.1/servers/e3a54301-d1b8-4060-b712-8d707bcfbef5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 12:58:05.838250 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-c178dd7c-ce78-48a4-a902-b4b16cfe9f62 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:05.846642 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c178dd7c-ce78-48a4-a902-b4b16cfe9f62 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1265 microversion: 2.1 time: 0.210433 Oct 03 12:58:05.847232 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 435/875] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:05 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:06.094117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e59f4069-12ed-407d-b2ba-2248c2681fcc tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] Calling method '.version_select at 0x7fc73bfb2280>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:06.227419 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e59f4069-12ed-407d-b2ba-2248c2681fcc tempest-TestShelveInstance-883453511 tempest-TestShelveInstance-883453511-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2145702352" status: 202 len: 0 microversion: 2.1 time: 0.137125 Oct 03 12:58:06.228001 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 441/876] 10.222.0.33 () {58 vars in 1254 bytes} [Mon Oct 3 12:58:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2145702352 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:58:06.873402 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-4c0ed75b-1aea-491f-a20c-f75d8007a152 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:06.873987 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-4c0ed75b-1aea-491f-a20c-f75d8007a152 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:06.880811 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4c0ed75b-1aea-491f-a20c-f75d8007a152 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:06.882657 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4c0ed75b-1aea-491f-a20c-f75d8007a152 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:06.883248 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4c0ed75b-1aea-491f-a20c-f75d8007a152 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:06.883997 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4c0ed75b-1aea-491f-a20c-f75d8007a152 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:06.884463 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4c0ed75b-1aea-491f-a20c-f75d8007a152 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:06.884900 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4c0ed75b-1aea-491f-a20c-f75d8007a152 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:07.107336 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4c0ed75b-1aea-491f-a20c-f75d8007a152 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:07.115191 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-4c0ed75b-1aea-491f-a20c-f75d8007a152 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1451 microversion: 2.1 time: 0.246664 Oct 03 12:58:07.116112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 436/877] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:06 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1451 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:58:07.138156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-bac2838d-8538-4916-8f6c-2d7723862807 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:07.138785 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-bac2838d-8538-4916-8f6c-2d7723862807 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:07.146401 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bac2838d-8538-4916-8f6c-2d7723862807 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:07.146907 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bac2838d-8538-4916-8f6c-2d7723862807 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:07.147565 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bac2838d-8538-4916-8f6c-2d7723862807 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:07.148495 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bac2838d-8538-4916-8f6c-2d7723862807 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:07.149042 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bac2838d-8538-4916-8f6c-2d7723862807 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:07.149483 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bac2838d-8538-4916-8f6c-2d7723862807 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:07.365063 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-bac2838d-8538-4916-8f6c-2d7723862807 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:07.374214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-bac2838d-8538-4916-8f6c-2d7723862807 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1451 microversion: 2.1 time: 0.240116 Oct 03 12:58:07.375116 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 442/878] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:07 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1451 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:09.595292 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-3053e83d-15be-4745-8c2e-2619b8a97afc req-42eff1de-ba0b-4a1c-8ec0-72f5f5ae6bbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6c4b7a-3b99-4a50-9703-a776b7b6b076", "tag": "c76db3b4-ecf1-4866-ba33-9d3ed7d5947b"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:58:09.613184 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-3053e83d-15be-4745-8c2e-2619b8a97afc req-42eff1de-ba0b-4a1c-8ec0-72f5f5ae6bbe service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:09.616090 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-3053e83d-15be-4745-8c2e-2619b8a97afc req-42eff1de-ba0b-4a1c-8ec0-72f5f5ae6bbe service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:09.621294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-3053e83d-15be-4745-8c2e-2619b8a97afc req-42eff1de-ba0b-4a1c-8ec0-72f5f5ae6bbe service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:09.636963 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-3053e83d-15be-4745-8c2e-2619b8a97afc req-42eff1de-ba0b-4a1c-8ec0-72f5f5ae6bbe service nova] Creating event network-changed:c76db3b4-ecf1-4866-ba33-9d3ed7d5947b for instance ee6c4b7a-3b99-4a50-9703-a776b7b6b076 on hv-cinder-84456 Oct 03 12:58:09.643549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-3053e83d-15be-4745-8c2e-2619b8a97afc req-42eff1de-ba0b-4a1c-8ec0-72f5f5ae6bbe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052994 Oct 03 12:58:09.644307 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 437/879] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:58:26.971851 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-96b100b3-6d01-42c1-90ed-b763ed586840 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:26.972388 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-96b100b3-6d01-42c1-90ed-b763ed586840 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:26.975382 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:58:26.976157 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=45 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:58:26.981297 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-96b100b3-6d01-42c1-90ed-b763ed586840 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:26.981929 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-96b100b3-6d01-42c1-90ed-b763ed586840 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:26.982333 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-96b100b3-6d01-42c1-90ed-b763ed586840 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:26.983046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-96b100b3-6d01-42c1-90ed-b763ed586840 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:26.983540 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-96b100b3-6d01-42c1-90ed-b763ed586840 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:26.987923 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-96b100b3-6d01-42c1-90ed-b763ed586840 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:27.008316 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-96b100b3-6d01-42c1-90ed-b763ed586840 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384/ips" status: 200 len: 151 microversion: 2.1 time: 0.040257 Oct 03 12:58:27.008886 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 443/880] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 12:58:26 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:58:27.019850 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:58:27.020600 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:58:27.026048 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-6f8ed06f-bbd0-4d6a-b39b-2322c3f1e2f7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "430d8811-49d2-4e68-8bd2-7e62b004613e"}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:58:27.028813 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-6f8ed06f-bbd0-4d6a-b39b-2322c3f1e2f7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:27.035003 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6f8ed06f-bbd0-4d6a-b39b-2322c3f1e2f7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:27.035525 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6f8ed06f-bbd0-4d6a-b39b-2322c3f1e2f7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:27.035968 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6f8ed06f-bbd0-4d6a-b39b-2322c3f1e2f7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:27.036664 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6f8ed06f-bbd0-4d6a-b39b-2322c3f1e2f7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:27.037121 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6f8ed06f-bbd0-4d6a-b39b-2322c3f1e2f7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:27.037547 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6f8ed06f-bbd0-4d6a-b39b-2322c3f1e2f7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:27.127505 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-6f8ed06f-bbd0-4d6a-b39b-2322c3f1e2f7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] HTTP exception thrown: Invalid volume: volume 430d8811-49d2-4e68-8bd2-7e62b004613e is already attached to instances: a7601de3-6bca-4b56-900b-e5bce92c1286 Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-6f8ed06f-bbd0-4d6a-b39b-2322c3f1e2f7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Request method failure captured: Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: POST /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384/os-volume_attachments HTTP/1.1 Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 74 Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtv1CNm_b3zyY3l-zqVpZ2PQwqysRe2xnTgm3TNFdQ3cxiuS5j1-KWYI4GxOIqIjyZXbTsRo_o30sxOzEi3tD56qI7VaNvXIBy0ny91RFTfbOk3WiMgFKVlDpWGpK6dHDg9Zbd0fRbIxhEH2S7Uy_tqxJtEm9mgtQiU5SFB6-mN0xzA Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: 484522301976426dae50e64c141c727e Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 12:58:27.129283 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 12:58:27.130755 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_484522301976426dae50e64c141c727e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/484522301976426dae50e64c141c727e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:58:27.130755 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-AttachVolumeNegativeTest-37738108 Oct 03 12:58:27.130755 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: 484522301976426dae50e64c141c727e Oct 03 12:58:27.130755 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 12:58:27.130755 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 12:58:27.130755 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 12:58:27.130755 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 12:58:27.130755 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: 5e29a4c0276247c286cff3eed5a1253a Oct 03 12:58:27.130755 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 12:58:27.130755 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Oct 03 12:58:27.130755 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {"volumeAttachment": {"volumeId": "430d8811-49d2-4e68-8bd2-7e62b004613e"}} Oct 03 12:58:27.130755 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Invalid volume: volume 430d8811-49d2-4e68-8bd2-7e62b004613e is already attached to instances: a7601de3-6bca-4b56-900b-e5bce92c1286 Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'server_id': '74732bd8-7fb6-4f8c-a46b-d58d6c1f4384', 'body': {'volumeAttachment': {'volumeId': '430d8811-49d2-4e68-8bd2-7e62b004613e'}}} Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 430d8811-49d2-4e68-8bd2-7e62b004613e is already attached to instances: a7601de3-6bca-4b56-900b-e5bce92c1286 Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:58:27.131639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 430d8811-49d2-4e68-8bd2-7e62b004613e is already attached to instances: a7601de3-6bca-4b56-900b-e5bce92c1286 Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:58:27.132903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:58:27.134280 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:58:27.134280 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:58:27.134280 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:58:27.134280 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 430d8811-49d2-4e68-8bd2-7e62b004613e is already attached to instances: a7601de3-6bca-4b56-900b-e5bce92c1286 Oct 03 12:58:27.134280 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 12:58:27.134280 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-6f8ed06f-bbd0-4d6a-b39b-2322c3f1e2f7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Returning 400 to user: Invalid volume: volume 430d8811-49d2-4e68-8bd2-7e62b004613e is already attached to instances: a7601de3-6bca-4b56-900b-e5bce92c1286 {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:58:27.134280 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-6f8ed06f-bbd0-4d6a-b39b-2322c3f1e2f7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "POST /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112761 Oct 03 12:58:27.134280 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 438/881] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 12:58:27 2022] POST /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 12:58:27.141084 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b69a3186-39c0-4efb-841d-2c7d4b8583ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:27.141592 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b69a3186-39c0-4efb-841d-2c7d4b8583ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:27.148922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b69a3186-39c0-4efb-841d-2c7d4b8583ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:27.149420 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b69a3186-39c0-4efb-841d-2c7d4b8583ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:27.149894 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b69a3186-39c0-4efb-841d-2c7d4b8583ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:27.150607 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b69a3186-39c0-4efb-841d-2c7d4b8583ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:27.151061 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b69a3186-39c0-4efb-841d-2c7d4b8583ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:27.151590 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b69a3186-39c0-4efb-841d-2c7d4b8583ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:27.178436 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b69a3186-39c0-4efb-841d-2c7d4b8583ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Going to try to terminate instance {{(pid=127542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:58:27.425945 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-b69a3186-39c0-4efb-841d-2c7d4b8583ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "DELETE /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 204 len: 0 microversion: 2.1 time: 0.289623 Oct 03 12:58:27.426454 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 444/882] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:58:27 2022] DELETE /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:58:27.435822 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9965e5cb-9309-4c75-ad7d-515b40704996 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:27.436442 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-9965e5cb-9309-4c75-ad7d-515b40704996 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:27.443682 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9965e5cb-9309-4c75-ad7d-515b40704996 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:27.444167 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9965e5cb-9309-4c75-ad7d-515b40704996 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:27.444601 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9965e5cb-9309-4c75-ad7d-515b40704996 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:27.445291 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9965e5cb-9309-4c75-ad7d-515b40704996 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:27.445745 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9965e5cb-9309-4c75-ad7d-515b40704996 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:27.446171 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9965e5cb-9309-4c75-ad7d-515b40704996 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:27.586853 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9965e5cb-9309-4c75-ad7d-515b40704996 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:27.597004 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-9965e5cb-9309-4c75-ad7d-515b40704996 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1680 microversion: 2.1 time: 0.163540 Oct 03 12:58:27.597004 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 439/883] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:27 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:28.622194 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-9fc4ab06-4a54-4a78-a420-cea5dc6f7f92 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:28.622194 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-9fc4ab06-4a54-4a78-a420-cea5dc6f7f92 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:28.628827 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9fc4ab06-4a54-4a78-a420-cea5dc6f7f92 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:28.629344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9fc4ab06-4a54-4a78-a420-cea5dc6f7f92 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:28.629734 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9fc4ab06-4a54-4a78-a420-cea5dc6f7f92 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:28.630548 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9fc4ab06-4a54-4a78-a420-cea5dc6f7f92 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:28.631009 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9fc4ab06-4a54-4a78-a420-cea5dc6f7f92 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:28.631650 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-9fc4ab06-4a54-4a78-a420-cea5dc6f7f92 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:28.769543 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-9fc4ab06-4a54-4a78-a420-cea5dc6f7f92 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:28.777130 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-9fc4ab06-4a54-4a78-a420-cea5dc6f7f92 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1680 microversion: 2.1 time: 0.162667 Oct 03 12:58:28.777692 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 445/884] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:28 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:58:29.800486 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-78e88b33-090f-4f93-b832-4a45eb6f2231 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:29.801025 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-78e88b33-090f-4f93-b832-4a45eb6f2231 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:29.807846 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-78e88b33-090f-4f93-b832-4a45eb6f2231 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:29.808335 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-78e88b33-090f-4f93-b832-4a45eb6f2231 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:29.808766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-78e88b33-090f-4f93-b832-4a45eb6f2231 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:29.810127 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-78e88b33-090f-4f93-b832-4a45eb6f2231 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:29.810616 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-78e88b33-090f-4f93-b832-4a45eb6f2231 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:29.811139 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-78e88b33-090f-4f93-b832-4a45eb6f2231 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:29.884648 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-78e88b33-090f-4f93-b832-4a45eb6f2231 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:29.894622 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-78e88b33-090f-4f93-b832-4a45eb6f2231 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1614 microversion: 2.1 time: 0.098037 Oct 03 12:58:29.895816 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 440/885] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:29 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1614 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:29.960289 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-e3200c8c-7a20-4d45-a074-ee922296f514 req-86d34648-f233-4c44-aaa7-1bfe4afe3042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74732bd8-7fb6-4f8c-a46b-d58d6c1f4384", "name": "network-vif-deleted", "tag": "dc215a76-62ab-4c80-b3aa-fbe015feab91"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:58:29.970437 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-e3200c8c-7a20-4d45-a074-ee922296f514 req-86d34648-f233-4c44-aaa7-1bfe4afe3042 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:29.970917 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-e3200c8c-7a20-4d45-a074-ee922296f514 req-86d34648-f233-4c44-aaa7-1bfe4afe3042 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:29.971392 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-e3200c8c-7a20-4d45-a074-ee922296f514 req-86d34648-f233-4c44-aaa7-1bfe4afe3042 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:29.983092 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-e3200c8c-7a20-4d45-a074-ee922296f514 req-86d34648-f233-4c44-aaa7-1bfe4afe3042 service nova] Creating event network-vif-deleted:dc215a76-62ab-4c80-b3aa-fbe015feab91 for instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 on hv-cinder-84456 Oct 03 12:58:29.988080 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-e3200c8c-7a20-4d45-a074-ee922296f514 req-86d34648-f233-4c44-aaa7-1bfe4afe3042 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031384 Oct 03 12:58:29.988734 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 446/886] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:58:30.921929 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-21ca5a7b-f877-4ee9-8e99-53e00da05d53 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:30.921929 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-21ca5a7b-f877-4ee9-8e99-53e00da05d53 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:30.933708 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-21ca5a7b-f877-4ee9-8e99-53e00da05d53 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:30.934886 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-21ca5a7b-f877-4ee9-8e99-53e00da05d53 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:30.935451 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-21ca5a7b-f877-4ee9-8e99-53e00da05d53 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:30.936261 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-21ca5a7b-f877-4ee9-8e99-53e00da05d53 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:30.936816 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-21ca5a7b-f877-4ee9-8e99-53e00da05d53 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:30.937357 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-21ca5a7b-f877-4ee9-8e99-53e00da05d53 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:30.982039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-21ca5a7b-f877-4ee9-8e99-53e00da05d53 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:30.982691 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-21ca5a7b-f877-4ee9-8e99-53e00da05d53 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:30.983238 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-21ca5a7b-f877-4ee9-8e99-53e00da05d53 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:30.983835 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-21ca5a7b-f877-4ee9-8e99-53e00da05d53 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lazy-loading 'fault' on Instance uuid 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:58:31.060466 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-21ca5a7b-f877-4ee9-8e99-53e00da05d53 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:31.069075 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-21ca5a7b-f877-4ee9-8e99-53e00da05d53 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 200 len: 1330 microversion: 2.1 time: 0.153814 Oct 03 12:58:31.069952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 441/887] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:30 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 1330 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:32.093224 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b76ea1ef-e7c6-4c7b-998d-0246d4be793b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:32.093930 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b76ea1ef-e7c6-4c7b-998d-0246d4be793b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:32.100011 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b76ea1ef-e7c6-4c7b-998d-0246d4be793b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:32.101538 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b76ea1ef-e7c6-4c7b-998d-0246d4be793b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:32.101538 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b76ea1ef-e7c6-4c7b-998d-0246d4be793b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:32.101742 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b76ea1ef-e7c6-4c7b-998d-0246d4be793b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:32.102046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b76ea1ef-e7c6-4c7b-998d-0246d4be793b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:32.102477 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b76ea1ef-e7c6-4c7b-998d-0246d4be793b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:32.115536 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-b76ea1ef-e7c6-4c7b-998d-0246d4be793b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] HTTP exception thrown: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b76ea1ef-e7c6-4c7b-998d-0246d4be793b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Request method failure captured: Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 HTTP/1.1 Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtv1CNm_b3zyY3l-zqVpZ2PQwqysRe2xnTgm3TNFdQ3cxiuS5j1-KWYI4GxOIqIjyZXbTsRo_o30sxOzEi3tD56qI7VaNvXIBy0ny91RFTfbOk3WiMgFKVlDpWGpK6dHDg9Zbd0fRbIxhEH2S7Uy_tqxJtEm9mgtQiU5SFB6-mN0xzA Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 484522301976426dae50e64c141c727e Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:58:32.117400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:58:32.120459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_484522301976426dae50e64c141c727e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/484522301976426dae50e64c141c727e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:58:32.120459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-AttachVolumeNegativeTest-37738108 Oct 03 12:58:32.120459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 484522301976426dae50e64c141c727e Oct 03 12:58:32.120459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 12:58:32.120459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 12:58:32.120459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:58:32.120459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:58:32.120459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 5e29a4c0276247c286cff3eed5a1253a Oct 03 12:58:32.120459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 12:58:32.120459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:58:32.120459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. Oct 03 12:58:32.120459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': '74732bd8-7fb6-4f8c-a46b-d58d6c1f4384'} Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:58:32.121253 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. Oct 03 12:58:32.123563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:58:32.124934 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b76ea1ef-e7c6-4c7b-998d-0246d4be793b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Returning 404 to user: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:58:32.124934 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-b76ea1ef-e7c6-4c7b-998d-0246d4be793b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 404 len: 111 microversion: 2.1 time: 0.030235 Oct 03 12:58:32.124934 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 447/888] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:32 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:58:32.128017 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-178271fb-ba74-40fd-83d6-37c023d9b79c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '.version_select at 0x7fc743a60af0>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:32.218517 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-178271fb-ba74-40fd-83d6-37c023d9b79c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-303812126" status: 202 len: 0 microversion: 2.1 time: 0.091068 Oct 03 12:58:32.219247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 442/889] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Oct 3 12:58:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-303812126 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 12:58:33.014677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-5e57edfb-62e6-42f6-88f5-d79a4a0b8a65 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:33.015190 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-5e57edfb-62e6-42f6-88f5-d79a4a0b8a65 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:33.021275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5e57edfb-62e6-42f6-88f5-d79a4a0b8a65 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:33.026944 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5e57edfb-62e6-42f6-88f5-d79a4a0b8a65 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:33.026944 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5e57edfb-62e6-42f6-88f5-d79a4a0b8a65 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:33.026944 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5e57edfb-62e6-42f6-88f5-d79a4a0b8a65 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:33.026944 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5e57edfb-62e6-42f6-88f5-d79a4a0b8a65 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:33.027343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5e57edfb-62e6-42f6-88f5-d79a4a0b8a65 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:33.106413 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-5e57edfb-62e6-42f6-88f5-d79a4a0b8a65 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lazy-loading 'services' on Instance uuid a7601de3-6bca-4b56-900b-e5bce92c1286 {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:58:33.356816 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-5e57edfb-62e6-42f6-88f5-d79a4a0b8a65 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286/os-volume_attachments/430d8811-49d2-4e68-8bd2-7e62b004613e" status: 202 len: 0 microversion: 2.1 time: 0.345921 Oct 03 12:58:33.357706 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 448/890] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 12:58:33 2022] DELETE /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286/os-volume_attachments/430d8811-49d2-4e68-8bd2-7e62b004613e => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:58:33.367328 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-cc4fdd64-bcc6-485a-a15a-016401298f6d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:33.369480 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-cc4fdd64-bcc6-485a-a15a-016401298f6d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:33.376488 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cc4fdd64-bcc6-485a-a15a-016401298f6d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:33.376979 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cc4fdd64-bcc6-485a-a15a-016401298f6d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:33.377424 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cc4fdd64-bcc6-485a-a15a-016401298f6d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:33.378122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cc4fdd64-bcc6-485a-a15a-016401298f6d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:33.378580 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cc4fdd64-bcc6-485a-a15a-016401298f6d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:33.379009 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-cc4fdd64-bcc6-485a-a15a-016401298f6d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:33.409227 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-cc4fdd64-bcc6-485a-a15a-016401298f6d tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047048 Oct 03 12:58:33.409802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 443/891] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 12:58:33 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:58:34.423288 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ce2872c2-6f8b-4123-9b11-0d10b07b5b5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:34.425552 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-ce2872c2-6f8b-4123-9b11-0d10b07b5b5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:34.431870 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ce2872c2-6f8b-4123-9b11-0d10b07b5b5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:34.432364 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ce2872c2-6f8b-4123-9b11-0d10b07b5b5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:34.432805 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ce2872c2-6f8b-4123-9b11-0d10b07b5b5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:34.433506 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ce2872c2-6f8b-4123-9b11-0d10b07b5b5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:34.434631 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ce2872c2-6f8b-4123-9b11-0d10b07b5b5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:34.435125 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ce2872c2-6f8b-4123-9b11-0d10b07b5b5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:34.464256 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-ce2872c2-6f8b-4123-9b11-0d10b07b5b5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045924 Oct 03 12:58:34.464856 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 449/892] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 12:58:34 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:58:35.477485 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-489c1c9c-6c23-4c31-84f5-b145b0880f59 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:35.479564 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-489c1c9c-6c23-4c31-84f5-b145b0880f59 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:35.486493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-489c1c9c-6c23-4c31-84f5-b145b0880f59 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:35.486974 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-489c1c9c-6c23-4c31-84f5-b145b0880f59 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:35.487442 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-489c1c9c-6c23-4c31-84f5-b145b0880f59 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:35.488177 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-489c1c9c-6c23-4c31-84f5-b145b0880f59 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:35.488650 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-489c1c9c-6c23-4c31-84f5-b145b0880f59 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:35.489073 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-489c1c9c-6c23-4c31-84f5-b145b0880f59 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:35.517589 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-489c1c9c-6c23-4c31-84f5-b145b0880f59 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044140 Oct 03 12:58:35.518134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 444/893] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 12:58:35 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 12:58:35.582061 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-8e3686bd-07b2-4bf9-ba3a-345d281b98de tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:35.582602 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8e3686bd-07b2-4bf9-ba3a-345d281b98de tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:35.589215 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8e3686bd-07b2-4bf9-ba3a-345d281b98de tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:35.589706 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8e3686bd-07b2-4bf9-ba3a-345d281b98de tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:35.590745 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8e3686bd-07b2-4bf9-ba3a-345d281b98de tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:35.591669 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8e3686bd-07b2-4bf9-ba3a-345d281b98de tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:35.592141 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8e3686bd-07b2-4bf9-ba3a-345d281b98de tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:35.592574 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-8e3686bd-07b2-4bf9-ba3a-345d281b98de tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:35.618435 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-8e3686bd-07b2-4bf9-ba3a-345d281b98de tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Going to try to terminate instance {{(pid=127542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:58:35.911004 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-8e3686bd-07b2-4bf9-ba3a-345d281b98de tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 204 len: 0 microversion: 2.1 time: 0.332557 Oct 03 12:58:35.911614 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 450/894] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:58:35 2022] DELETE /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:58:35.920778 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-82515115-0959-44c8-940f-d7e387563db9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:35.921393 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-82515115-0959-44c8-940f-d7e387563db9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:35.927296 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-82515115-0959-44c8-940f-d7e387563db9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:35.927807 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-82515115-0959-44c8-940f-d7e387563db9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:35.928251 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-82515115-0959-44c8-940f-d7e387563db9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:35.928937 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-82515115-0959-44c8-940f-d7e387563db9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:35.929389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-82515115-0959-44c8-940f-d7e387563db9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:35.929816 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-82515115-0959-44c8-940f-d7e387563db9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:36.058981 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-82515115-0959-44c8-940f-d7e387563db9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:36.066643 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-82515115-0959-44c8-940f-d7e387563db9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 200 len: 1682 microversion: 2.1 time: 0.150589 Oct 03 12:58:36.067204 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 445/895] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:35 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:37.091303 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-241f60b3-cb1d-4257-a600-9914cf18c92f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:37.092091 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-241f60b3-cb1d-4257-a600-9914cf18c92f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:37.098625 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-241f60b3-cb1d-4257-a600-9914cf18c92f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:37.099118 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-241f60b3-cb1d-4257-a600-9914cf18c92f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:37.099598 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-241f60b3-cb1d-4257-a600-9914cf18c92f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:37.100304 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-241f60b3-cb1d-4257-a600-9914cf18c92f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:37.100769 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-241f60b3-cb1d-4257-a600-9914cf18c92f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:37.101213 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-241f60b3-cb1d-4257-a600-9914cf18c92f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:37.229859 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-241f60b3-cb1d-4257-a600-9914cf18c92f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:37.238988 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-241f60b3-cb1d-4257-a600-9914cf18c92f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 200 len: 1682 microversion: 2.1 time: 0.153046 Oct 03 12:58:37.239598 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 451/896] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:37 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:38.270455 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-52e58650-aa51-47a0-a639-3698d8b9bca0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:38.271257 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-52e58650-aa51-47a0-a639-3698d8b9bca0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:38.278820 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-52e58650-aa51-47a0-a639-3698d8b9bca0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:38.279633 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-52e58650-aa51-47a0-a639-3698d8b9bca0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:38.280118 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-52e58650-aa51-47a0-a639-3698d8b9bca0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:38.281811 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-52e58650-aa51-47a0-a639-3698d8b9bca0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:38.282566 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-52e58650-aa51-47a0-a639-3698d8b9bca0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:38.283387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-52e58650-aa51-47a0-a639-3698d8b9bca0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:38.429059 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-52e58650-aa51-47a0-a639-3698d8b9bca0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:38.437884 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-52e58650-aa51-47a0-a639-3698d8b9bca0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 200 len: 1682 microversion: 2.1 time: 0.171532 Oct 03 12:58:38.438417 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 446/897] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:38 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:38.737658 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-70403b80-38db-419d-9b80-c3f6f8f4609c req-363e9237-1580-4c4c-b0a2-af5f06e41cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7601de3-6bca-4b56-900b-e5bce92c1286", "name": "network-vif-deleted", "tag": "4edf1405-fc52-4599-ac23-ab2575e40645"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:58:38.748011 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-70403b80-38db-419d-9b80-c3f6f8f4609c req-363e9237-1580-4c4c-b0a2-af5f06e41cd9 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:38.748547 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-70403b80-38db-419d-9b80-c3f6f8f4609c req-363e9237-1580-4c4c-b0a2-af5f06e41cd9 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:38.748982 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-70403b80-38db-419d-9b80-c3f6f8f4609c req-363e9237-1580-4c4c-b0a2-af5f06e41cd9 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:38.760240 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-70403b80-38db-419d-9b80-c3f6f8f4609c req-363e9237-1580-4c4c-b0a2-af5f06e41cd9 service nova] Creating event network-vif-deleted:4edf1405-fc52-4599-ac23-ab2575e40645 for instance a7601de3-6bca-4b56-900b-e5bce92c1286 on hv-cinder-84456 Oct 03 12:58:38.765263 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-70403b80-38db-419d-9b80-c3f6f8f4609c req-363e9237-1580-4c4c-b0a2-af5f06e41cd9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031249 Oct 03 12:58:38.766933 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 452/898] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:58:39.462170 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-f619d5db-e760-4c5b-bc1b-49d9dd3eaf49 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:39.462870 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-f619d5db-e760-4c5b-bc1b-49d9dd3eaf49 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:39.470293 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f619d5db-e760-4c5b-bc1b-49d9dd3eaf49 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:39.470787 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f619d5db-e760-4c5b-bc1b-49d9dd3eaf49 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:39.471218 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f619d5db-e760-4c5b-bc1b-49d9dd3eaf49 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:39.471947 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f619d5db-e760-4c5b-bc1b-49d9dd3eaf49 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:39.472402 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f619d5db-e760-4c5b-bc1b-49d9dd3eaf49 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:39.472822 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f619d5db-e760-4c5b-bc1b-49d9dd3eaf49 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:39.516128 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f619d5db-e760-4c5b-bc1b-49d9dd3eaf49 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:39.516622 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f619d5db-e760-4c5b-bc1b-49d9dd3eaf49 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:39.517056 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f619d5db-e760-4c5b-bc1b-49d9dd3eaf49 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:39.517507 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-f619d5db-e760-4c5b-bc1b-49d9dd3eaf49 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lazy-loading 'fault' on Instance uuid a7601de3-6bca-4b56-900b-e5bce92c1286 {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:58:39.565119 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-f619d5db-e760-4c5b-bc1b-49d9dd3eaf49 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:39.577653 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-f619d5db-e760-4c5b-bc1b-49d9dd3eaf49 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 200 len: 1332 microversion: 2.1 time: 0.115500 Oct 03 12:58:39.577653 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 447/899] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:39 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:40.603443 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7b897784-be7a-4b81-8a09-8a28662dacae tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:40.604038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-7b897784-be7a-4b81-8a09-8a28662dacae tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:40.610936 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b897784-be7a-4b81-8a09-8a28662dacae tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:40.611444 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b897784-be7a-4b81-8a09-8a28662dacae tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:40.611879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b897784-be7a-4b81-8a09-8a28662dacae tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:40.612563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b897784-be7a-4b81-8a09-8a28662dacae tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:40.613017 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b897784-be7a-4b81-8a09-8a28662dacae tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:40.613443 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b897784-be7a-4b81-8a09-8a28662dacae tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:40.627340 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-7b897784-be7a-4b81-8a09-8a28662dacae tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] HTTP exception thrown: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7b897784-be7a-4b81-8a09-8a28662dacae tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Request method failure captured: Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 HTTP/1.1 Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtv1CNm_b3zyY3l-zqVpZ2PQwqysRe2xnTgm3TNFdQ3cxiuS5j1-KWYI4GxOIqIjyZXbTsRo_o30sxOzEi3tD56qI7VaNvXIBy0ny91RFTfbOk3WiMgFKVlDpWGpK6dHDg9Zbd0fRbIxhEH2S7Uy_tqxJtEm9mgtQiU5SFB6-mN0xzA Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 484522301976426dae50e64c141c727e Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:58:40.628970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:58:40.630618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_484522301976426dae50e64c141c727e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/484522301976426dae50e64c141c727e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:58:40.630618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-AttachVolumeNegativeTest-37738108 Oct 03 12:58:40.630618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 484522301976426dae50e64c141c727e Oct 03 12:58:40.630618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 12:58:40.630618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 12:58:40.630618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:58:40.630618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:58:40.630618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 5e29a4c0276247c286cff3eed5a1253a Oct 03 12:58:40.630618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 12:58:40.630618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:58:40.630618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. Oct 03 12:58:40.630618 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': 'a7601de3-6bca-4b56-900b-e5bce92c1286'} Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:58:40.631473 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. Oct 03 12:58:40.632897 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:58:40.634797 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7b897784-be7a-4b81-8a09-8a28662dacae tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Returning 404 to user: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:58:40.634797 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-7b897784-be7a-4b81-8a09-8a28662dacae tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 404 len: 111 microversion: 2.1 time: 0.031994 Oct 03 12:58:40.634797 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 453/900] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:40 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:58:40.639265 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9fc8c023-3709-4cf0-b684-b29f5262a7f4 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '.version_select at 0x7fc74023d5e0>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:40.735342 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-9fc8c023-3709-4cf0-b684-b29f5262a7f4 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175916272" status: 202 len: 0 microversion: 2.1 time: 0.099716 Oct 03 12:58:40.735930 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 448/901] 10.222.0.33 () {58 vars in 1221 bytes} [Mon Oct 3 12:58:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175916272 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:58:41.525449 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-bc93258e-c268-435a-b7b6-b18175dbaa0e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Action: 'create', calling method: .version_select at 0x7fc7400b1310>, body: {"keypair": {"name": "tempest-keypair-245205535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnd1HcsJ2ql+TPY8Ql3EWdXbklpJXf7npgiu5Q9PsWOJybfb7Wd00uvPNcYG7JBRaHFfOs+Tt8ifBRSrjEd6rDve7WSbaj+DGVRaT3SKqSym9kpSCStnJE/4cAcslpfag=="}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:58:41.542251 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-bc93258e-c268-435a-b7b6-b18175dbaa0e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Getting quotas for project 484522301976426dae50e64c141c727e. Resources: {'key_pairs'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:58:41.546558 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-bc93258e-c268-435a-b7b6-b18175dbaa0e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Getting quotas for user 5e29a4c0276247c286cff3eed5a1253a and project 484522301976426dae50e64c141c727e. Resources: {'key_pairs'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:58:41.655934 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-bc93258e-c268-435a-b7b6-b18175dbaa0e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.134537 Oct 03 12:58:41.656853 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 454/902] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 12:58:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:58:43.999651 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1892140077", "imageRef": "9d585789-e496-433d-b311-70ec7ceffd99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c116e69-b6ec-41cd-b2b6-637e304e9d46"}], "security_groups": [{"name": "tempest-securitygroup--1945178314"}], "key_name": "tempest-keypair-245205535", "user_data": "}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:58:44.109831 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.network.neutron [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] validate_networks() for [('1c116e69-b6ec-41cd-b2b6-637e304e9d46', None, None, None, None, None)] {{(pid=127544) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:58:44.511043 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Flavor limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:58:44.511516 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Image limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:58:44.512669 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Flavor pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:58:44.513115 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Image pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:58:44.513799 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:58:44.523757 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:44.524248 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:44.524694 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:44.525432 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:44.525894 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:44.526327 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:44.546351 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Getting quotas for project 484522301976426dae50e64c141c727e. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:58:44.550309 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Getting quotas for user 5e29a4c0276247c286cff3eed5a1253a and project 484522301976426dae50e64c141c727e. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:58:44.561505 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Going to run 1 instances... {{(pid=127544) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:58:44.563851 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d585789-e496-433d-b311-70ec7ceffd99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:58:44.678996 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-98290e90-0a8a-4c62-adbf-22c3c58e23e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.683795 Oct 03 12:58:44.686212 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 449/903] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:58:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:58:44.707352 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-23ee2229-31be-44b3-94d9-35367c29fc05 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:44.707352 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-23ee2229-31be-44b3-94d9-35367c29fc05 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:44.760741 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-23ee2229-31be-44b3-94d9-35367c29fc05 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:44.769233 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-23ee2229-31be-44b3-94d9-35367c29fc05 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 200 len: 1241 microversion: 2.1 time: 0.068696 Oct 03 12:58:44.769838 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 455/904] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:44 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:45.792287 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-304d4b42-413d-4bbe-bf86-ae59d9ebc8f9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:45.793157 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-304d4b42-413d-4bbe-bf86-ae59d9ebc8f9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:45.799870 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-304d4b42-413d-4bbe-bf86-ae59d9ebc8f9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:45.800367 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-304d4b42-413d-4bbe-bf86-ae59d9ebc8f9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:45.800803 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-304d4b42-413d-4bbe-bf86-ae59d9ebc8f9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:45.801510 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-304d4b42-413d-4bbe-bf86-ae59d9ebc8f9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:45.801965 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-304d4b42-413d-4bbe-bf86-ae59d9ebc8f9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:45.802388 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-304d4b42-413d-4bbe-bf86-ae59d9ebc8f9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:45.866996 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-304d4b42-413d-4bbe-bf86-ae59d9ebc8f9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:45.874882 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-304d4b42-413d-4bbe-bf86-ae59d9ebc8f9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 200 len: 1245 microversion: 2.1 time: 0.086828 Oct 03 12:58:45.875486 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 450/905] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:45 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:46.898462 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f1922fc8-f951-4892-ab08-9bbde2d930b6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:46.899117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f1922fc8-f951-4892-ab08-9bbde2d930b6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:46.906330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f1922fc8-f951-4892-ab08-9bbde2d930b6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:46.906822 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f1922fc8-f951-4892-ab08-9bbde2d930b6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:46.907262 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f1922fc8-f951-4892-ab08-9bbde2d930b6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:46.907994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f1922fc8-f951-4892-ab08-9bbde2d930b6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:46.908460 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f1922fc8-f951-4892-ab08-9bbde2d930b6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:46.908893 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f1922fc8-f951-4892-ab08-9bbde2d930b6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:46.973476 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-f1922fc8-f951-4892-ab08-9bbde2d930b6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:46.981870 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f1922fc8-f951-4892-ab08-9bbde2d930b6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 200 len: 1293 microversion: 2.1 time: 0.087243 Oct 03 12:58:46.991630 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 456/906] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:46 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:48.007481 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-44b36376-cd57-4c31-b969-a46b0f1043d1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:48.008204 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-44b36376-cd57-4c31-b969-a46b0f1043d1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:48.015269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-44b36376-cd57-4c31-b969-a46b0f1043d1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:48.029831 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-44b36376-cd57-4c31-b969-a46b0f1043d1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:48.029831 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-44b36376-cd57-4c31-b969-a46b0f1043d1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:48.029831 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-44b36376-cd57-4c31-b969-a46b0f1043d1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:48.029831 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-44b36376-cd57-4c31-b969-a46b0f1043d1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:48.030930 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-44b36376-cd57-4c31-b969-a46b0f1043d1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:48.167708 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-44b36376-cd57-4c31-b969-a46b0f1043d1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:48.176750 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-44b36376-cd57-4c31-b969-a46b0f1043d1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 200 len: 1367 microversion: 2.1 time: 0.174792 Oct 03 12:58:48.178612 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 451/907] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:48 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:48.797705 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-f6c5c25e-c7c1-404c-b909-fe180c4f19d9 req-b18810d6-c3c5-4140-ada8-dd91fc9f9fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77b582d3-a18f-4bed-adf0-5f8107ef89da", "tag": "4bae14e7-4422-4487-9365-b229427bf0d6"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:58:48.809666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-f6c5c25e-c7c1-404c-b909-fe180c4f19d9 req-b18810d6-c3c5-4140-ada8-dd91fc9f9fe1 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:48.810389 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-f6c5c25e-c7c1-404c-b909-fe180c4f19d9 req-b18810d6-c3c5-4140-ada8-dd91fc9f9fe1 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:48.811066 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-f6c5c25e-c7c1-404c-b909-fe180c4f19d9 req-b18810d6-c3c5-4140-ada8-dd91fc9f9fe1 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:48.823520 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-f6c5c25e-c7c1-404c-b909-fe180c4f19d9 req-b18810d6-c3c5-4140-ada8-dd91fc9f9fe1 service nova] Creating event network-changed:4bae14e7-4422-4487-9365-b229427bf0d6 for instance 77b582d3-a18f-4bed-adf0-5f8107ef89da on hv-cinder-84456 Oct 03 12:58:48.829999 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-f6c5c25e-c7c1-404c-b909-fe180c4f19d9 req-b18810d6-c3c5-4140-ada8-dd91fc9f9fe1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036249 Oct 03 12:58:48.831213 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 457/908] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:58:49.201546 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-559fc596-7b9c-48ca-a553-4a85379524e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:49.202362 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-559fc596-7b9c-48ca-a553-4a85379524e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:49.211157 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-559fc596-7b9c-48ca-a553-4a85379524e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:49.211723 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-559fc596-7b9c-48ca-a553-4a85379524e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:49.212131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-559fc596-7b9c-48ca-a553-4a85379524e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:49.212840 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-559fc596-7b9c-48ca-a553-4a85379524e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:49.213294 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-559fc596-7b9c-48ca-a553-4a85379524e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:49.213749 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-559fc596-7b9c-48ca-a553-4a85379524e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:49.381467 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-559fc596-7b9c-48ca-a553-4a85379524e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:49.390960 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-559fc596-7b9c-48ca-a553-4a85379524e1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 200 len: 1367 microversion: 2.1 time: 0.193355 Oct 03 12:58:49.391791 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 452/909] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:49 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:50.415648 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-cc8ee9f9-7ab3-4c03-85b2-d2fdc243887e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:50.416362 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-cc8ee9f9-7ab3-4c03-85b2-d2fdc243887e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:50.422831 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc8ee9f9-7ab3-4c03-85b2-d2fdc243887e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:50.423344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc8ee9f9-7ab3-4c03-85b2-d2fdc243887e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:50.423793 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc8ee9f9-7ab3-4c03-85b2-d2fdc243887e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:50.424490 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc8ee9f9-7ab3-4c03-85b2-d2fdc243887e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:50.424951 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc8ee9f9-7ab3-4c03-85b2-d2fdc243887e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:50.425405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc8ee9f9-7ab3-4c03-85b2-d2fdc243887e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:50.559262 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-cc8ee9f9-7ab3-4c03-85b2-d2fdc243887e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:50.567289 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-cc8ee9f9-7ab3-4c03-85b2-d2fdc243887e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 200 len: 1367 microversion: 2.1 time: 0.156416 Oct 03 12:58:50.567890 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 458/910] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:50 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:58:51.591989 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a62d5bca-dfea-4294-ada2-3c6722bd8ce1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:51.592625 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a62d5bca-dfea-4294-ada2-3c6722bd8ce1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:51.599033 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a62d5bca-dfea-4294-ada2-3c6722bd8ce1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:51.600171 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a62d5bca-dfea-4294-ada2-3c6722bd8ce1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:51.600171 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a62d5bca-dfea-4294-ada2-3c6722bd8ce1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:51.600735 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a62d5bca-dfea-4294-ada2-3c6722bd8ce1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:51.601176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a62d5bca-dfea-4294-ada2-3c6722bd8ce1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:51.602033 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a62d5bca-dfea-4294-ada2-3c6722bd8ce1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:51.733120 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-a62d5bca-dfea-4294-ada2-3c6722bd8ce1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:51.740809 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a62d5bca-dfea-4294-ada2-3c6722bd8ce1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 200 len: 1367 microversion: 2.1 time: 0.152902 Oct 03 12:58:51.741579 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 453/911] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:51 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:52.764256 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0d0a5277-f8d6-4058-969c-ca28ec2ef2ed tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:52.764982 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-0d0a5277-f8d6-4058-969c-ca28ec2ef2ed tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:52.771946 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0d0a5277-f8d6-4058-969c-ca28ec2ef2ed tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:52.772439 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0d0a5277-f8d6-4058-969c-ca28ec2ef2ed tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:52.772875 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0d0a5277-f8d6-4058-969c-ca28ec2ef2ed tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:52.773574 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0d0a5277-f8d6-4058-969c-ca28ec2ef2ed tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:52.774033 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0d0a5277-f8d6-4058-969c-ca28ec2ef2ed tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:52.774459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-0d0a5277-f8d6-4058-969c-ca28ec2ef2ed tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:52.909882 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-0d0a5277-f8d6-4058-969c-ca28ec2ef2ed tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:52.917565 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-0d0a5277-f8d6-4058-969c-ca28ec2ef2ed tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 200 len: 1367 microversion: 2.1 time: 0.157347 Oct 03 12:58:52.918130 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 459/912] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:52 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:53.941504 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d07c5e9d-6957-49ed-be75-4cc14f940fc7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:53.943007 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d07c5e9d-6957-49ed-be75-4cc14f940fc7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:53.949898 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d07c5e9d-6957-49ed-be75-4cc14f940fc7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:53.950566 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d07c5e9d-6957-49ed-be75-4cc14f940fc7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:53.951012 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d07c5e9d-6957-49ed-be75-4cc14f940fc7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:53.951758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d07c5e9d-6957-49ed-be75-4cc14f940fc7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:53.952255 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d07c5e9d-6957-49ed-be75-4cc14f940fc7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:53.952810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d07c5e9d-6957-49ed-be75-4cc14f940fc7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:54.054263 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-6464ea61-67a8-4461-828b-7b11e1194786 req-0618c7af-af0c-4510-9916-aea2e888ce83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b582d3-a18f-4bed-adf0-5f8107ef89da", "name": "network-vif-plugged", "status": "completed", "tag": "4bae14e7-4422-4487-9365-b229427bf0d6"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:58:54.066813 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-6464ea61-67a8-4461-828b-7b11e1194786 req-0618c7af-af0c-4510-9916-aea2e888ce83 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:54.067295 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-6464ea61-67a8-4461-828b-7b11e1194786 req-0618c7af-af0c-4510-9916-aea2e888ce83 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:54.067749 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-6464ea61-67a8-4461-828b-7b11e1194786 req-0618c7af-af0c-4510-9916-aea2e888ce83 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:54.079036 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-6464ea61-67a8-4461-828b-7b11e1194786 req-0618c7af-af0c-4510-9916-aea2e888ce83 service nova] Creating event network-vif-plugged:4bae14e7-4422-4487-9365-b229427bf0d6 for instance 77b582d3-a18f-4bed-adf0-5f8107ef89da on hv-cinder-84456 Oct 03 12:58:54.084048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-6464ea61-67a8-4461-828b-7b11e1194786 req-0618c7af-af0c-4510-9916-aea2e888ce83 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033899 Oct 03 12:58:54.084641 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 460/913] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:58:54.166306 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d07c5e9d-6957-49ed-be75-4cc14f940fc7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:54.176161 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d07c5e9d-6957-49ed-be75-4cc14f940fc7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 200 len: 1367 microversion: 2.1 time: 0.239111 Oct 03 12:58:54.177220 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 454/914] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:53 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:55.197639 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=6 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:58:55.203046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ff233590-78dc-4c38-9202-2e4aa084b63e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:55.203811 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-ff233590-78dc-4c38-9202-2e4aa084b63e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:55.209877 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ff233590-78dc-4c38-9202-2e4aa084b63e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:55.210363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ff233590-78dc-4c38-9202-2e4aa084b63e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:55.211175 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ff233590-78dc-4c38-9202-2e4aa084b63e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:55.212534 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ff233590-78dc-4c38-9202-2e4aa084b63e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:55.213169 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ff233590-78dc-4c38-9202-2e4aa084b63e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:55.213599 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ff233590-78dc-4c38-9202-2e4aa084b63e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:55.362060 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-ff233590-78dc-4c38-9202-2e4aa084b63e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:55.365872 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:58:55.370515 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-ff233590-78dc-4c38-9202-2e4aa084b63e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 200 len: 1367 microversion: 2.1 time: 0.173796 Oct 03 12:58:55.371182 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 461/915] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:55 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:56.393932 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e94c9903-998d-4430-ac13-6d42baecfdfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:56.394553 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-e94c9903-998d-4430-ac13-6d42baecfdfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:56.396428 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=2 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:58:56.398801 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=6 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:58:56.402614 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e94c9903-998d-4430-ac13-6d42baecfdfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:56.403926 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e94c9903-998d-4430-ac13-6d42baecfdfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:56.404569 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e94c9903-998d-4430-ac13-6d42baecfdfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:56.405279 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e94c9903-998d-4430-ac13-6d42baecfdfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:56.405737 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e94c9903-998d-4430-ac13-6d42baecfdfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:56.406167 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e94c9903-998d-4430-ac13-6d42baecfdfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:56.540908 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e94c9903-998d-4430-ac13-6d42baecfdfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:58:56.549280 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e94c9903-998d-4430-ac13-6d42baecfdfa tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 200 len: 1557 microversion: 2.1 time: 0.159136 Oct 03 12:58:56.551461 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 455/916] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:58:56 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:58:56.572151 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-54636311-c810-4842-a706-037777ccbd86 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:58:56.572651 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-54636311-c810-4842-a706-037777ccbd86 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:58:56.580418 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-54636311-c810-4842-a706-037777ccbd86 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:56.580924 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-54636311-c810-4842-a706-037777ccbd86 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:56.581369 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-54636311-c810-4842-a706-037777ccbd86 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:56.582317 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-54636311-c810-4842-a706-037777ccbd86 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:56.582546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-54636311-c810-4842-a706-037777ccbd86 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:56.582971 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-54636311-c810-4842-a706-037777ccbd86 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:56.667836 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-54636311-c810-4842-a706-037777ccbd86 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099478 Oct 03 12:58:56.668514 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 462/917] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Oct 3 12:58:56 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:58:57.827383 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-a4e984db-7989-40db-8651-756187b2a670 req-90e05a22-830e-46ed-990b-f01b2c88b6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77b582d3-a18f-4bed-adf0-5f8107ef89da", "tag": "4bae14e7-4422-4487-9365-b229427bf0d6"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:58:57.832746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:58:57.837953 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-a4e984db-7989-40db-8651-756187b2a670 req-90e05a22-830e-46ed-990b-f01b2c88b6f8 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:58:57.838371 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-a4e984db-7989-40db-8651-756187b2a670 req-90e05a22-830e-46ed-990b-f01b2c88b6f8 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:58:57.838850 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-a4e984db-7989-40db-8651-756187b2a670 req-90e05a22-830e-46ed-990b-f01b2c88b6f8 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:58:57.841469 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=97 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:58:57.850881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-a4e984db-7989-40db-8651-756187b2a670 req-90e05a22-830e-46ed-990b-f01b2c88b6f8 service nova] Creating event network-changed:4bae14e7-4422-4487-9365-b229427bf0d6 for instance 77b582d3-a18f-4bed-adf0-5f8107ef89da on hv-cinder-84456 Oct 03 12:58:57.856492 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-a4e984db-7989-40db-8651-756187b2a670 req-90e05a22-830e-46ed-990b-f01b2c88b6f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033472 Oct 03 12:58:57.857409 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 456/918] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:59:20.666452 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:59:20.667195 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=4 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:59:20.671140 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-bfd06ece-750e-4872-ae1e-1a41356a776e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Action: 'create', calling method: .version_select at 0x7fc73bfc51f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2032278945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC9jtzdS0biP7uYK1da3+HOLlqZh2czkQa3PTKiFMJa9il0iU/OZXuQKaYf+TSee9ayYfIR5z446hgawVUHQr16rXF80J1o6Mha0BOqbDOe9oO5HYT7OR+qhXZ7DEeZAw=="}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:59:20.686078 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-bfd06ece-750e-4872-ae1e-1a41356a776e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Getting quotas for project a0a4271779a04986bbd34e2e989f3603. Resources: {'key_pairs'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:59:20.689862 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-bfd06ece-750e-4872-ae1e-1a41356a776e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Getting quotas for user 9a4a9a635aaf44c7b81224a6b0ad9dec and project a0a4271779a04986bbd34e2e989f3603. Resources: {'key_pairs'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:59:20.763196 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-bfd06ece-750e-4872-ae1e-1a41356a776e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.098076 Oct 03 12:59:20.763819 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 463/919] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 12:59:20 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:59:20.817010 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1764522525", "imageRef": "506fd796-3f78-4c6f-ab40-e9e5199a016d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2032278945", "networks": [{"uuid": "f899b1e8-33ea-4d75-a53c-f3e9c281806e"}]}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:59:20.869254 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.network.neutron [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] validate_networks() for [('f899b1e8-33ea-4d75-a53c-f3e9c281806e', None, None, None, None, None)] {{(pid=127544) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:59:21.228766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Flavor limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:59:21.229196 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Image limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:59:21.229672 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Flavor pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:59:21.230089 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Image pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:59:21.230501 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:59:21.240002 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:21.240486 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:21.240957 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:21.241686 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:21.242142 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:21.242837 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:21.260343 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Getting quotas for project a0a4271779a04986bbd34e2e989f3603. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:59:21.265774 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Getting quotas for user 9a4a9a635aaf44c7b81224a6b0ad9dec and project a0a4271779a04986bbd34e2e989f3603. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:59:21.278502 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Going to run 1 instances... {{(pid=127544) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:59:21.280903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='506fd796-3f78-4c6f-ab40-e9e5199a016d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:59:21.432585 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a89552ec-7e35-4a2a-a3ed-70080e38312e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621027 Oct 03 12:59:21.433119 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 457/920] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:59:21.444815 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f9c529f2-80d7-435e-b89c-ebcc0a852218 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:21.447764 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f9c529f2-80d7-435e-b89c-ebcc0a852218 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:21.502629 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-f9c529f2-80d7-435e-b89c-ebcc0a852218 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:21.509524 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f9c529f2-80d7-435e-b89c-ebcc0a852218 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1259 microversion: 2.1 time: 0.069236 Oct 03 12:59:21.510069 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 464/921] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:21 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:22.533954 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b5dff528-5657-4ddc-8c7c-48f6182a34aa tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:22.534491 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-b5dff528-5657-4ddc-8c7c-48f6182a34aa tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:22.588548 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-b5dff528-5657-4ddc-8c7c-48f6182a34aa tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:22.596472 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-b5dff528-5657-4ddc-8c7c-48f6182a34aa tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1259 microversion: 2.1 time: 0.067245 Oct 03 12:59:22.597067 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 458/922] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:22 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:23.619981 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7db06229-4b29-41cc-8c99-003c9323f9b3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:23.620554 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-7db06229-4b29-41cc-8c99-003c9323f9b3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:23.628545 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7db06229-4b29-41cc-8c99-003c9323f9b3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:23.629031 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7db06229-4b29-41cc-8c99-003c9323f9b3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:23.629470 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7db06229-4b29-41cc-8c99-003c9323f9b3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:23.630157 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7db06229-4b29-41cc-8c99-003c9323f9b3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:23.630620 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7db06229-4b29-41cc-8c99-003c9323f9b3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:23.631043 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7db06229-4b29-41cc-8c99-003c9323f9b3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:23.692842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-7db06229-4b29-41cc-8c99-003c9323f9b3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:23.700545 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-7db06229-4b29-41cc-8c99-003c9323f9b3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1311 microversion: 2.1 time: 0.084909 Oct 03 12:59:23.701113 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 465/923] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:23 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:24.728365 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d459ca78-2283-43ae-8e8a-3e036f26749b tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:24.738302 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d459ca78-2283-43ae-8e8a-3e036f26749b tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:24.769205 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d459ca78-2283-43ae-8e8a-3e036f26749b tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:24.769626 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d459ca78-2283-43ae-8e8a-3e036f26749b tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:24.770063 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d459ca78-2283-43ae-8e8a-3e036f26749b tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:24.770778 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d459ca78-2283-43ae-8e8a-3e036f26749b tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:24.771233 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d459ca78-2283-43ae-8e8a-3e036f26749b tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:24.771742 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d459ca78-2283-43ae-8e8a-3e036f26749b tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:24.860629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d459ca78-2283-43ae-8e8a-3e036f26749b tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:24.873769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d459ca78-2283-43ae-8e8a-3e036f26749b tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1317 microversion: 2.1 time: 0.152835 Oct 03 12:59:24.874712 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 459/924] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:24 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:59:25.896358 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-90ead293-9a22-44dd-a38c-dfcf6e27c274 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:25.897245 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-90ead293-9a22-44dd-a38c-dfcf6e27c274 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:25.904577 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-90ead293-9a22-44dd-a38c-dfcf6e27c274 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:25.905390 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-90ead293-9a22-44dd-a38c-dfcf6e27c274 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:25.905907 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-90ead293-9a22-44dd-a38c-dfcf6e27c274 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:25.906691 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-90ead293-9a22-44dd-a38c-dfcf6e27c274 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:25.907262 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-90ead293-9a22-44dd-a38c-dfcf6e27c274 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:25.907784 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-90ead293-9a22-44dd-a38c-dfcf6e27c274 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:26.045561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-90ead293-9a22-44dd-a38c-dfcf6e27c274 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:26.053273 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-90ead293-9a22-44dd-a38c-dfcf6e27c274 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1359 microversion: 2.1 time: 0.160790 Oct 03 12:59:26.053849 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 466/925] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:25 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:27.076337 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bb87ad55-b0bb-44cd-9836-1463e3fc7eed tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:27.076952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-bb87ad55-b0bb-44cd-9836-1463e3fc7eed tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:27.083952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb87ad55-b0bb-44cd-9836-1463e3fc7eed tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:27.084586 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb87ad55-b0bb-44cd-9836-1463e3fc7eed tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:27.085020 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb87ad55-b0bb-44cd-9836-1463e3fc7eed tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:27.085932 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb87ad55-b0bb-44cd-9836-1463e3fc7eed tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:27.086517 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb87ad55-b0bb-44cd-9836-1463e3fc7eed tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:27.086943 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-bb87ad55-b0bb-44cd-9836-1463e3fc7eed tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:27.444691 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-bb87ad55-b0bb-44cd-9836-1463e3fc7eed tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:27.450750 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-bb87ad55-b0bb-44cd-9836-1463e3fc7eed tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1359 microversion: 2.1 time: 0.378211 Oct 03 12:59:27.451434 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 460/926] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:27 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1359 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:28.473914 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-5c2de0ef-b0bf-4c98-892c-df8f7c21f1c6 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:28.475340 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-5c2de0ef-b0bf-4c98-892c-df8f7c21f1c6 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:28.482450 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5c2de0ef-b0bf-4c98-892c-df8f7c21f1c6 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:28.483260 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5c2de0ef-b0bf-4c98-892c-df8f7c21f1c6 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:28.483406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5c2de0ef-b0bf-4c98-892c-df8f7c21f1c6 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:28.484181 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5c2de0ef-b0bf-4c98-892c-df8f7c21f1c6 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:28.484643 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5c2de0ef-b0bf-4c98-892c-df8f7c21f1c6 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:28.485078 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5c2de0ef-b0bf-4c98-892c-df8f7c21f1c6 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:28.678433 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-5c2de0ef-b0bf-4c98-892c-df8f7c21f1c6 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:28.686687 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-5c2de0ef-b0bf-4c98-892c-df8f7c21f1c6 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1359 microversion: 2.1 time: 0.216478 Oct 03 12:59:28.687545 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 467/927] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:28 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:29.711044 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-f9d3342e-1398-4c2e-b29e-37787040d9b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:29.711715 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-f9d3342e-1398-4c2e-b29e-37787040d9b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:29.718681 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f9d3342e-1398-4c2e-b29e-37787040d9b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:29.719166 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f9d3342e-1398-4c2e-b29e-37787040d9b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:29.719634 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f9d3342e-1398-4c2e-b29e-37787040d9b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:29.720334 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f9d3342e-1398-4c2e-b29e-37787040d9b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:29.720788 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f9d3342e-1398-4c2e-b29e-37787040d9b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:29.721212 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f9d3342e-1398-4c2e-b29e-37787040d9b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:30.124562 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-f9d3342e-1398-4c2e-b29e-37787040d9b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:30.132552 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-f9d3342e-1398-4c2e-b29e-37787040d9b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1359 microversion: 2.1 time: 0.426392 Oct 03 12:59:30.133133 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 461/928] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:29 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1359 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:31.156674 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7861737a-3049-4e88-b6c7-c8ad9d39c538 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:31.157409 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-7861737a-3049-4e88-b6c7-c8ad9d39c538 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:31.164118 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7861737a-3049-4e88-b6c7-c8ad9d39c538 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:31.164614 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7861737a-3049-4e88-b6c7-c8ad9d39c538 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:31.165058 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7861737a-3049-4e88-b6c7-c8ad9d39c538 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:31.165764 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7861737a-3049-4e88-b6c7-c8ad9d39c538 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:31.166223 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7861737a-3049-4e88-b6c7-c8ad9d39c538 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:31.166652 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7861737a-3049-4e88-b6c7-c8ad9d39c538 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:31.298313 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-7861737a-3049-4e88-b6c7-c8ad9d39c538 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:31.306086 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-7861737a-3049-4e88-b6c7-c8ad9d39c538 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1359 microversion: 2.1 time: 0.154336 Oct 03 12:59:31.306899 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 468/929] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:31 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:32.331966 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-27b9cb31-a214-48d1-a4da-0dd5506cfc9c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:32.332981 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-27b9cb31-a214-48d1-a4da-0dd5506cfc9c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:32.336136 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=2 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:59:32.341302 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-27b9cb31-a214-48d1-a4da-0dd5506cfc9c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:32.341805 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-27b9cb31-a214-48d1-a4da-0dd5506cfc9c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:32.344091 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-27b9cb31-a214-48d1-a4da-0dd5506cfc9c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:32.344091 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-27b9cb31-a214-48d1-a4da-0dd5506cfc9c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:32.344091 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-27b9cb31-a214-48d1-a4da-0dd5506cfc9c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:32.345798 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-27b9cb31-a214-48d1-a4da-0dd5506cfc9c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:32.518304 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-27b9cb31-a214-48d1-a4da-0dd5506cfc9c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:32.528358 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-27b9cb31-a214-48d1-a4da-0dd5506cfc9c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1359 microversion: 2.1 time: 0.202002 Oct 03 12:59:32.543808 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 462/930] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:32 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:33.558896 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-af0588c1-ad03-4735-80bb-cce421376b16 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:33.559551 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-af0588c1-ad03-4735-80bb-cce421376b16 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:33.561407 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=6 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:59:33.567217 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-af0588c1-ad03-4735-80bb-cce421376b16 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:33.567757 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-af0588c1-ad03-4735-80bb-cce421376b16 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:33.568239 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-af0588c1-ad03-4735-80bb-cce421376b16 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:33.568945 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-af0588c1-ad03-4735-80bb-cce421376b16 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:33.569458 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-af0588c1-ad03-4735-80bb-cce421376b16 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:33.569893 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-af0588c1-ad03-4735-80bb-cce421376b16 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:33.696030 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-af0588c1-ad03-4735-80bb-cce421376b16 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:33.703663 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-af0588c1-ad03-4735-80bb-cce421376b16 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1359 microversion: 2.1 time: 0.148929 Oct 03 12:59:33.705040 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 469/931] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:33 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:34.038780 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-f3d40bce-8ba9-4464-84ad-43bacbcde9a7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:34.039371 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-f3d40bce-8ba9-4464-84ad-43bacbcde9a7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:34.041196 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=8 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:59:34.046370 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f3d40bce-8ba9-4464-84ad-43bacbcde9a7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:34.046855 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f3d40bce-8ba9-4464-84ad-43bacbcde9a7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:34.047289 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f3d40bce-8ba9-4464-84ad-43bacbcde9a7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:34.048664 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f3d40bce-8ba9-4464-84ad-43bacbcde9a7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:34.049111 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f3d40bce-8ba9-4464-84ad-43bacbcde9a7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:34.049535 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f3d40bce-8ba9-4464-84ad-43bacbcde9a7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:34.074725 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-f3d40bce-8ba9-4464-84ad-43bacbcde9a7 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da/ips" status: 200 len: 149 microversion: 2.1 time: 0.039775 Oct 03 12:59:34.075280 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 463/932] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 12:59:34 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:59:34.726375 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ac07c579-e2d8-4dab-96b3-8bbccd00834d tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:34.727025 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-ac07c579-e2d8-4dab-96b3-8bbccd00834d tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:34.733436 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ac07c579-e2d8-4dab-96b3-8bbccd00834d tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:34.734762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ac07c579-e2d8-4dab-96b3-8bbccd00834d tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:34.734762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ac07c579-e2d8-4dab-96b3-8bbccd00834d tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:34.735818 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ac07c579-e2d8-4dab-96b3-8bbccd00834d tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:34.736439 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ac07c579-e2d8-4dab-96b3-8bbccd00834d tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:34.736872 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ac07c579-e2d8-4dab-96b3-8bbccd00834d tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:34.869345 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-ac07c579-e2d8-4dab-96b3-8bbccd00834d tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:34.877511 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-ac07c579-e2d8-4dab-96b3-8bbccd00834d tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1359 microversion: 2.1 time: 0.154989 Oct 03 12:59:34.878078 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 470/933] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:34 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:35.689355 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-dd579b54-770d-419b-832c-74198fc3ffd9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5097c71-3650-4239-8e13-0085d0423ea4"}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:59:35.691826 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-dd579b54-770d-419b-832c-74198fc3ffd9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:35.698709 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dd579b54-770d-419b-832c-74198fc3ffd9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:35.699195 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dd579b54-770d-419b-832c-74198fc3ffd9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:35.699666 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dd579b54-770d-419b-832c-74198fc3ffd9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:35.700360 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dd579b54-770d-419b-832c-74198fc3ffd9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:35.700823 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dd579b54-770d-419b-832c-74198fc3ffd9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:35.701251 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dd579b54-770d-419b-832c-74198fc3ffd9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:35.900943 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-824b9ef6-cee8-4764-b0d5-86d108e172e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:35.901873 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-824b9ef6-cee8-4764-b0d5-86d108e172e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:35.909556 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-824b9ef6-cee8-4764-b0d5-86d108e172e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:35.910057 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-824b9ef6-cee8-4764-b0d5-86d108e172e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:35.910501 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-824b9ef6-cee8-4764-b0d5-86d108e172e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:35.911205 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-824b9ef6-cee8-4764-b0d5-86d108e172e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:35.911700 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-824b9ef6-cee8-4764-b0d5-86d108e172e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:35.912134 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-824b9ef6-cee8-4764-b0d5-86d108e172e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:36.052012 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-824b9ef6-cee8-4764-b0d5-86d108e172e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:36.060315 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-824b9ef6-cee8-4764-b0d5-86d108e172e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1359 microversion: 2.1 time: 0.163147 Oct 03 12:59:36.060902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 471/934] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:35 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:59:36.567892 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-dd579b54-770d-419b-832c-74198fc3ffd9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "POST /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.883029 Oct 03 12:59:36.568925 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 464/935] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 12:59:35 2022] POST /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da/os-volume_attachments => generated 194 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:59:36.801814 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-6de39119-fb5f-44ea-94e8-0bad52d77eed req-f2b4656b-4f93-4690-897d-5b95cc2e8546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "229aaf8a-e3ce-4319-94b4-7e22662880b3", "tag": "f317c1e2-f283-4fec-bf28-0094dfcd58ff"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:59:36.811339 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-6de39119-fb5f-44ea-94e8-0bad52d77eed req-f2b4656b-4f93-4690-897d-5b95cc2e8546 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:36.811851 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-6de39119-fb5f-44ea-94e8-0bad52d77eed req-f2b4656b-4f93-4690-897d-5b95cc2e8546 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:36.812302 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-6de39119-fb5f-44ea-94e8-0bad52d77eed req-f2b4656b-4f93-4690-897d-5b95cc2e8546 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:36.824398 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-6de39119-fb5f-44ea-94e8-0bad52d77eed req-f2b4656b-4f93-4690-897d-5b95cc2e8546 service nova] Creating event network-changed:f317c1e2-f283-4fec-bf28-0094dfcd58ff for instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 on hv-cinder-84456 Oct 03 12:59:36.829979 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-6de39119-fb5f-44ea-94e8-0bad52d77eed req-f2b4656b-4f93-4690-897d-5b95cc2e8546 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032547 Oct 03 12:59:36.830597 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 472/936] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:59:37.086052 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3b9c3a54-a7d7-43d3-83c4-cabacc6a604c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:37.086756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-3b9c3a54-a7d7-43d3-83c4-cabacc6a604c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:37.093695 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3b9c3a54-a7d7-43d3-83c4-cabacc6a604c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:37.094187 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3b9c3a54-a7d7-43d3-83c4-cabacc6a604c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:37.095424 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3b9c3a54-a7d7-43d3-83c4-cabacc6a604c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:37.096092 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3b9c3a54-a7d7-43d3-83c4-cabacc6a604c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:37.096548 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3b9c3a54-a7d7-43d3-83c4-cabacc6a604c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:37.096971 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3b9c3a54-a7d7-43d3-83c4-cabacc6a604c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:37.228408 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3b9c3a54-a7d7-43d3-83c4-cabacc6a604c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:37.237046 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-3b9c3a54-a7d7-43d3-83c4-cabacc6a604c tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1359 microversion: 2.1 time: 0.155959 Oct 03 12:59:37.237861 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 465/937] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:37 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:38.261606 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-96798f72-2002-4c43-b7e4-af8e9fa332e4 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:38.262232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-96798f72-2002-4c43-b7e4-af8e9fa332e4 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:38.269673 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-96798f72-2002-4c43-b7e4-af8e9fa332e4 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:38.270242 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-96798f72-2002-4c43-b7e4-af8e9fa332e4 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:38.270737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-96798f72-2002-4c43-b7e4-af8e9fa332e4 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:38.271794 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-96798f72-2002-4c43-b7e4-af8e9fa332e4 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:38.271957 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-96798f72-2002-4c43-b7e4-af8e9fa332e4 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:38.272503 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-96798f72-2002-4c43-b7e4-af8e9fa332e4 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:38.415344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-96798f72-2002-4c43-b7e4-af8e9fa332e4 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:38.424752 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-96798f72-2002-4c43-b7e4-af8e9fa332e4 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1359 microversion: 2.1 time: 0.167667 Oct 03 12:59:38.425431 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 473/938] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:38 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:39.449734 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-018e1071-e2bf-4a4c-9bad-90db2364d1d9 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:39.450346 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-018e1071-e2bf-4a4c-9bad-90db2364d1d9 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:39.457262 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-018e1071-e2bf-4a4c-9bad-90db2364d1d9 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:39.457742 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-018e1071-e2bf-4a4c-9bad-90db2364d1d9 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:39.458176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-018e1071-e2bf-4a4c-9bad-90db2364d1d9 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:39.458858 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-018e1071-e2bf-4a4c-9bad-90db2364d1d9 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:39.459305 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-018e1071-e2bf-4a4c-9bad-90db2364d1d9 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:39.459746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-018e1071-e2bf-4a4c-9bad-90db2364d1d9 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:39.585646 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-018e1071-e2bf-4a4c-9bad-90db2364d1d9 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:39.593231 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-018e1071-e2bf-4a4c-9bad-90db2364d1d9 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1359 microversion: 2.1 time: 0.147354 Oct 03 12:59:39.593785 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 466/939] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:39 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:40.617415 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-935d9d26-9e3a-4520-b26d-f896be090383 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:40.618244 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-935d9d26-9e3a-4520-b26d-f896be090383 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:40.624865 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-935d9d26-9e3a-4520-b26d-f896be090383 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:40.625355 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-935d9d26-9e3a-4520-b26d-f896be090383 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:40.626132 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-935d9d26-9e3a-4520-b26d-f896be090383 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:40.627229 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-935d9d26-9e3a-4520-b26d-f896be090383 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:40.627988 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-935d9d26-9e3a-4520-b26d-f896be090383 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:40.628460 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-935d9d26-9e3a-4520-b26d-f896be090383 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:40.761317 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-935d9d26-9e3a-4520-b26d-f896be090383 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:40.769610 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-935d9d26-9e3a-4520-b26d-f896be090383 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1359 microversion: 2.1 time: 0.156548 Oct 03 12:59:40.770195 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 474/940] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:40 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:41.792840 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-efce0e43-d82f-4c30-9911-99210792ef38 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:41.793489 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-efce0e43-d82f-4c30-9911-99210792ef38 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:41.800769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-efce0e43-d82f-4c30-9911-99210792ef38 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:41.801253 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-efce0e43-d82f-4c30-9911-99210792ef38 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:41.801685 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-efce0e43-d82f-4c30-9911-99210792ef38 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:41.802376 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-efce0e43-d82f-4c30-9911-99210792ef38 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:41.802829 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-efce0e43-d82f-4c30-9911-99210792ef38 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:41.803255 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-efce0e43-d82f-4c30-9911-99210792ef38 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:41.934426 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-efce0e43-d82f-4c30-9911-99210792ef38 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:41.943267 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-efce0e43-d82f-4c30-9911-99210792ef38 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1359 microversion: 2.1 time: 0.154177 Oct 03 12:59:41.943860 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 467/941] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:41 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:42.302706 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-a446f6b0-0e23-4f0b-bcf5-9125f5e2f86e req-fdcef46f-5287-49fa-9a50-ed62c9a95e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "229aaf8a-e3ce-4319-94b4-7e22662880b3", "name": "network-vif-plugged", "status": "completed", "tag": "f317c1e2-f283-4fec-bf28-0094dfcd58ff"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:59:42.312714 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-a446f6b0-0e23-4f0b-bcf5-9125f5e2f86e req-fdcef46f-5287-49fa-9a50-ed62c9a95e5b service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:42.321454 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-a446f6b0-0e23-4f0b-bcf5-9125f5e2f86e req-fdcef46f-5287-49fa-9a50-ed62c9a95e5b service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:42.321454 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-a446f6b0-0e23-4f0b-bcf5-9125f5e2f86e req-fdcef46f-5287-49fa-9a50-ed62c9a95e5b service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:42.325005 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-a446f6b0-0e23-4f0b-bcf5-9125f5e2f86e req-fdcef46f-5287-49fa-9a50-ed62c9a95e5b service nova] Creating event network-vif-plugged:f317c1e2-f283-4fec-bf28-0094dfcd58ff for instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 on hv-cinder-84456 Oct 03 12:59:42.330450 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-a446f6b0-0e23-4f0b-bcf5-9125f5e2f86e req-fdcef46f-5287-49fa-9a50-ed62c9a95e5b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031680 Oct 03 12:59:42.331037 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 475/942] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:59:42.979687 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-4165e53c-1be1-42bc-b6a1-090feeb25ae7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:42.979687 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-4165e53c-1be1-42bc-b6a1-090feeb25ae7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:42.983726 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4165e53c-1be1-42bc-b6a1-090feeb25ae7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:42.984212 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4165e53c-1be1-42bc-b6a1-090feeb25ae7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:42.984646 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4165e53c-1be1-42bc-b6a1-090feeb25ae7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:42.986189 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4165e53c-1be1-42bc-b6a1-090feeb25ae7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:42.986609 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4165e53c-1be1-42bc-b6a1-090feeb25ae7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:42.987035 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4165e53c-1be1-42bc-b6a1-090feeb25ae7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:43.111426 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4165e53c-1be1-42bc-b6a1-090feeb25ae7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:43.119340 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-4165e53c-1be1-42bc-b6a1-090feeb25ae7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1359 microversion: 2.1 time: 0.146603 Oct 03 12:59:43.119909 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 468/943] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:42 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:44.116701 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-be90d543-c9ff-40c5-ad86-d4bc0b098296 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5097c71-3650-4239-8e13-0085d0423ea4"}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:59:44.119387 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-be90d543-c9ff-40c5-ad86-d4bc0b098296 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:44.126437 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-be90d543-c9ff-40c5-ad86-d4bc0b098296 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:44.126945 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-be90d543-c9ff-40c5-ad86-d4bc0b098296 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:44.127407 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-be90d543-c9ff-40c5-ad86-d4bc0b098296 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:44.128232 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-be90d543-c9ff-40c5-ad86-d4bc0b098296 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:44.128578 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-be90d543-c9ff-40c5-ad86-d4bc0b098296 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:44.129008 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-be90d543-c9ff-40c5-ad86-d4bc0b098296 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:44.141713 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-528ef8aa-b08d-4e98-b5e7-50b2c71cec2e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:44.142333 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-528ef8aa-b08d-4e98-b5e7-50b2c71cec2e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:44.149116 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-528ef8aa-b08d-4e98-b5e7-50b2c71cec2e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:44.149612 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-528ef8aa-b08d-4e98-b5e7-50b2c71cec2e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:44.150056 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-528ef8aa-b08d-4e98-b5e7-50b2c71cec2e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:44.150765 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-528ef8aa-b08d-4e98-b5e7-50b2c71cec2e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:44.151227 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-528ef8aa-b08d-4e98-b5e7-50b2c71cec2e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:44.151695 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-528ef8aa-b08d-4e98-b5e7-50b2c71cec2e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:44.210311 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-be90d543-c9ff-40c5-ad86-d4bc0b098296 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] HTTP exception thrown: Invalid volume: volume b5097c71-3650-4239-8e13-0085d0423ea4 is already attached to instances: 77b582d3-a18f-4bed-adf0-5f8107ef89da Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-be90d543-c9ff-40c5-ad86-d4bc0b098296 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Request method failure captured: Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: POST /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da/os-volume_attachments HTTP/1.1 Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 74 Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtv1CNm_b3zyY3l-zqVpZ2PQwqysRe2xnTgm3TNFdQ3cxiuS5j1-KWYI4GxOIqIjyZXbTsRo_o30sxOzEi3tD56qI7VaNvXIBy0ny91RFTfbOk3WiMgFKVlDpWGpK6dHDg9Zbd0fRbIxhEH2S7Uy_tqxJtEm9mgtQiU5SFB6-mN0xzA Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 484522301976426dae50e64c141c727e Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:59:44.212072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:59:44.214241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_484522301976426dae50e64c141c727e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/484522301976426dae50e64c141c727e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:59:44.214241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-AttachVolumeNegativeTest-37738108 Oct 03 12:59:44.214241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 484522301976426dae50e64c141c727e Oct 03 12:59:44.214241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 12:59:44.214241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 12:59:44.214241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:59:44.214241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:59:44.214241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 5e29a4c0276247c286cff3eed5a1253a Oct 03 12:59:44.214241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 12:59:44.214241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Oct 03 12:59:44.214241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {"volumeAttachment": {"volumeId": "b5097c71-3650-4239-8e13-0085d0423ea4"}} Oct 03 12:59:44.214241 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Invalid volume: volume b5097c71-3650-4239-8e13-0085d0423ea4 is already attached to instances: 77b582d3-a18f-4bed-adf0-5f8107ef89da Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'server_id': '77b582d3-a18f-4bed-adf0-5f8107ef89da', 'body': {'volumeAttachment': {'volumeId': 'b5097c71-3650-4239-8e13-0085d0423ea4'}}} Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b5097c71-3650-4239-8e13-0085d0423ea4 is already attached to instances: 77b582d3-a18f-4bed-adf0-5f8107ef89da Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:59:44.215179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b5097c71-3650-4239-8e13-0085d0423ea4 is already attached to instances: 77b582d3-a18f-4bed-adf0-5f8107ef89da Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:59:44.216737 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:59:44.218257 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:59:44.218257 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:59:44.218257 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:59:44.218257 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b5097c71-3650-4239-8e13-0085d0423ea4 is already attached to instances: 77b582d3-a18f-4bed-adf0-5f8107ef89da Oct 03 12:59:44.218257 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:59:44.218257 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-be90d543-c9ff-40c5-ad86-d4bc0b098296 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Returning 400 to user: Invalid volume: volume b5097c71-3650-4239-8e13-0085d0423ea4 is already attached to instances: 77b582d3-a18f-4bed-adf0-5f8107ef89da {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:59:44.218257 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-be90d543-c9ff-40c5-ad86-d4bc0b098296 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "POST /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102003 Oct 03 12:59:44.218257 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 476/944] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 12:59:44 2022] POST /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 12:59:44.303872 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-528ef8aa-b08d-4e98-b5e7-50b2c71cec2e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:44.311536 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-528ef8aa-b08d-4e98-b5e7-50b2c71cec2e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1359 microversion: 2.1 time: 0.173638 Oct 03 12:59:44.312094 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 469/945] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:44 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:59:44.312229 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-76fc538d-b274-47f0-9867-5ed20630a1ad tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:44.319563 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-76fc538d-b274-47f0-9867-5ed20630a1ad tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:44.326921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-76fc538d-b274-47f0-9867-5ed20630a1ad tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:44.329261 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-76fc538d-b274-47f0-9867-5ed20630a1ad tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:44.329261 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-76fc538d-b274-47f0-9867-5ed20630a1ad tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:44.329261 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-76fc538d-b274-47f0-9867-5ed20630a1ad tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:44.329261 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-76fc538d-b274-47f0-9867-5ed20630a1ad tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:44.329671 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-76fc538d-b274-47f0-9867-5ed20630a1ad tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:44.410921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-76fc538d-b274-47f0-9867-5ed20630a1ad tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lazy-loading 'services' on Instance uuid 77b582d3-a18f-4bed-adf0-5f8107ef89da {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:59:44.623653 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-76fc538d-b274-47f0-9867-5ed20630a1ad tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "DELETE /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da/os-volume_attachments/b5097c71-3650-4239-8e13-0085d0423ea4" status: 202 len: 0 microversion: 2.1 time: 0.315175 Oct 03 12:59:44.624282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 477/946] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 12:59:44 2022] DELETE /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da/os-volume_attachments/b5097c71-3650-4239-8e13-0085d0423ea4 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 12:59:44.633236 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-14edc05a-aced-4b68-8aee-63427b8b9174 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:44.636549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-14edc05a-aced-4b68-8aee-63427b8b9174 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:44.643904 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-14edc05a-aced-4b68-8aee-63427b8b9174 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:44.644415 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-14edc05a-aced-4b68-8aee-63427b8b9174 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:44.644936 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-14edc05a-aced-4b68-8aee-63427b8b9174 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:44.645920 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-14edc05a-aced-4b68-8aee-63427b8b9174 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:44.646413 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-14edc05a-aced-4b68-8aee-63427b8b9174 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:44.646839 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-14edc05a-aced-4b68-8aee-63427b8b9174 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:44.678256 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-14edc05a-aced-4b68-8aee-63427b8b9174 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049405 Oct 03 12:59:44.678817 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 470/947] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 12:59:44 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:59:45.332229 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 12:59:45.332778 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Mon Oct 3 12:59:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 (ip 10.222.0.33) !!! Oct 03 12:59:45.337560 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a9e68c25-be34-4f0f-8d87-787e62e85357 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:45.338344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a9e68c25-be34-4f0f-8d87-787e62e85357 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:45.347209 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a9e68c25-be34-4f0f-8d87-787e62e85357 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:45.347741 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a9e68c25-be34-4f0f-8d87-787e62e85357 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:45.348178 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a9e68c25-be34-4f0f-8d87-787e62e85357 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:45.348876 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a9e68c25-be34-4f0f-8d87-787e62e85357 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:45.349332 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a9e68c25-be34-4f0f-8d87-787e62e85357 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:45.349792 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a9e68c25-be34-4f0f-8d87-787e62e85357 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:45.482104 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a9e68c25-be34-4f0f-8d87-787e62e85357 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:45.489971 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a9e68c25-be34-4f0f-8d87-787e62e85357 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1549 microversion: 2.1 time: 0.159052 Oct 03 12:59:45.490569 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 478/948] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:45 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:45.511980 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-025051d6-3473-47e2-a543-467901d01401 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:45.512513 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-025051d6-3473-47e2-a543-467901d01401 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:45.519446 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-025051d6-3473-47e2-a543-467901d01401 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:45.519932 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-025051d6-3473-47e2-a543-467901d01401 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:45.520370 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-025051d6-3473-47e2-a543-467901d01401 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:45.521062 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-025051d6-3473-47e2-a543-467901d01401 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:45.521515 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-025051d6-3473-47e2-a543-467901d01401 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:45.521940 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-025051d6-3473-47e2-a543-467901d01401 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:45.668312 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-025051d6-3473-47e2-a543-467901d01401 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:45.675986 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-025051d6-3473-47e2-a543-467901d01401 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1549 microversion: 2.1 time: 0.167821 Oct 03 12:59:45.676548 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 471/949] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:45 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:45.690753 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b3f5182e-9db2-4b62-b41b-283544eb7ee5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:45.693358 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b3f5182e-9db2-4b62-b41b-283544eb7ee5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:45.697839 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-66156c95-106a-44d1-b16a-ae5b2f1f16c3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:45.699463 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b3f5182e-9db2-4b62-b41b-283544eb7ee5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:45.699953 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b3f5182e-9db2-4b62-b41b-283544eb7ee5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:45.700389 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b3f5182e-9db2-4b62-b41b-283544eb7ee5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:45.701091 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b3f5182e-9db2-4b62-b41b-283544eb7ee5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:45.701542 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b3f5182e-9db2-4b62-b41b-283544eb7ee5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:45.702063 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b3f5182e-9db2-4b62-b41b-283544eb7ee5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:45.702540 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-66156c95-106a-44d1-b16a-ae5b2f1f16c3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:45.703199 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-66156c95-106a-44d1-b16a-ae5b2f1f16c3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Searching by: {'deleted': False, 'project_id': 'a0a4271779a04986bbd34e2e989f3603'} {{(pid=127544) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 12:59:45.710813 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-66156c95-106a-44d1-b16a-ae5b2f1f16c3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:45.711300 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-66156c95-106a-44d1-b16a-ae5b2f1f16c3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:45.711769 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-66156c95-106a-44d1-b16a-ae5b2f1f16c3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:45.712493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-66156c95-106a-44d1-b16a-ae5b2f1f16c3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:45.712952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-66156c95-106a-44d1-b16a-ae5b2f1f16c3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:45.713370 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-66156c95-106a-44d1-b16a-ae5b2f1f16c3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:45.732609 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-b3f5182e-9db2-4b62-b41b-283544eb7ee5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046417 Oct 03 12:59:45.733354 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 479/950] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 12:59:45 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:59:45.803366 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.multi_cell_list [None req-66156c95-106a-44d1-b16a-ae5b2f1f16c3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 12:59:45.899065 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-66156c95-106a-44d1-b16a-ae5b2f1f16c3 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204780 Oct 03 12:59:45.899672 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 472/951] 10.222.0.33 () {58 vars in 1125 bytes} [Mon Oct 3 12:59:45 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:59:45.911160 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-278825bb-a271-4ca7-bfdf-064c0e777245 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:45.911802 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-278825bb-a271-4ca7-bfdf-064c0e777245 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:45.917687 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-278825bb-a271-4ca7-bfdf-064c0e777245 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:45.918179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-278825bb-a271-4ca7-bfdf-064c0e777245 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:45.918609 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-278825bb-a271-4ca7-bfdf-064c0e777245 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:45.919293 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-278825bb-a271-4ca7-bfdf-064c0e777245 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:45.919781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-278825bb-a271-4ca7-bfdf-064c0e777245 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:45.920202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-278825bb-a271-4ca7-bfdf-064c0e777245 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:46.049611 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-278825bb-a271-4ca7-bfdf-064c0e777245 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:46.057944 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-278825bb-a271-4ca7-bfdf-064c0e777245 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1549 microversion: 2.1 time: 0.150076 Oct 03 12:59:46.057944 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 480/952] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:45 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:46.750836 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-c6895a22-bbab-4178-9c5a-bb33d423aa50 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:46.753485 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-c6895a22-bbab-4178-9c5a-bb33d423aa50 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:46.760206 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c6895a22-bbab-4178-9c5a-bb33d423aa50 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:46.770201 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c6895a22-bbab-4178-9c5a-bb33d423aa50 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:46.770201 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c6895a22-bbab-4178-9c5a-bb33d423aa50 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:46.770201 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c6895a22-bbab-4178-9c5a-bb33d423aa50 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:46.770201 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c6895a22-bbab-4178-9c5a-bb33d423aa50 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:46.770781 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-c6895a22-bbab-4178-9c5a-bb33d423aa50 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:46.789278 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:59:46.793379 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-c6895a22-bbab-4178-9c5a-bb33d423aa50 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047343 Oct 03 12:59:46.793930 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 473/953] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 12:59:46 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 12:59:46.861453 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1ec83651-47bb-4cb0-aa01-fc573933deb4 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:46.862475 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-1ec83651-47bb-4cb0-aa01-fc573933deb4 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:46.869993 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1ec83651-47bb-4cb0-aa01-fc573933deb4 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:46.874085 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1ec83651-47bb-4cb0-aa01-fc573933deb4 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:46.874085 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1ec83651-47bb-4cb0-aa01-fc573933deb4 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:46.874085 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1ec83651-47bb-4cb0-aa01-fc573933deb4 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:46.874085 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1ec83651-47bb-4cb0-aa01-fc573933deb4 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:46.874551 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1ec83651-47bb-4cb0-aa01-fc573933deb4 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:46.900928 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-1ec83651-47bb-4cb0-aa01-fc573933deb4 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Going to try to terminate instance {{(pid=127542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:59:46.915975 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:59:47.144571 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-1ec83651-47bb-4cb0-aa01-fc573933deb4 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "DELETE /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 204 len: 0 microversion: 2.1 time: 0.286857 Oct 03 12:59:47.145160 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 481/954] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:59:46 2022] DELETE /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:59:47.153480 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-00f73b82-54fc-49f6-850d-67ec01662ab6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:47.155243 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-00f73b82-54fc-49f6-850d-67ec01662ab6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:47.162799 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-00f73b82-54fc-49f6-850d-67ec01662ab6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:47.163288 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-00f73b82-54fc-49f6-850d-67ec01662ab6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:47.163745 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-00f73b82-54fc-49f6-850d-67ec01662ab6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:47.164437 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-00f73b82-54fc-49f6-850d-67ec01662ab6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:47.164890 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-00f73b82-54fc-49f6-850d-67ec01662ab6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:47.165310 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-00f73b82-54fc-49f6-850d-67ec01662ab6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:47.300184 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-00f73b82-54fc-49f6-850d-67ec01662ab6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:47.307823 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-00f73b82-54fc-49f6-850d-67ec01662ab6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 200 len: 1681 microversion: 2.1 time: 0.158371 Oct 03 12:59:47.308378 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 474/955] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:47 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:48.034596 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d053617b-baf5-44e4-a62d-6a4d337d5715 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a333f01f-4a0f-4e2b-a5b5-b954557f7a17"}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:59:48.037048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d053617b-baf5-44e4-a62d-6a4d337d5715 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:48.043370 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d053617b-baf5-44e4-a62d-6a4d337d5715 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:48.043859 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d053617b-baf5-44e4-a62d-6a4d337d5715 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:48.044336 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d053617b-baf5-44e4-a62d-6a4d337d5715 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:48.045027 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d053617b-baf5-44e4-a62d-6a4d337d5715 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:48.045482 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d053617b-baf5-44e4-a62d-6a4d337d5715 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:48.045909 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d053617b-baf5-44e4-a62d-6a4d337d5715 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:48.331983 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-856ba89f-74d1-40f4-b6f1-b875417cff6c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:48.332555 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-856ba89f-74d1-40f4-b6f1-b875417cff6c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:48.338939 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-856ba89f-74d1-40f4-b6f1-b875417cff6c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:48.339464 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-856ba89f-74d1-40f4-b6f1-b875417cff6c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:48.339905 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-856ba89f-74d1-40f4-b6f1-b875417cff6c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:48.340600 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-856ba89f-74d1-40f4-b6f1-b875417cff6c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:48.341060 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-856ba89f-74d1-40f4-b6f1-b875417cff6c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:48.341489 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-856ba89f-74d1-40f4-b6f1-b875417cff6c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:48.475466 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-856ba89f-74d1-40f4-b6f1-b875417cff6c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:48.483290 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-856ba89f-74d1-40f4-b6f1-b875417cff6c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 200 len: 1681 microversion: 2.1 time: 0.155931 Oct 03 12:59:48.483881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 475/956] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:48 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:59:49.138818 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d053617b-baf5-44e4-a62d-6a4d337d5715 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "POST /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.108088 Oct 03 12:59:49.140040 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 482/957] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 12:59:48 2022] POST /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3/os-volume_attachments => generated 194 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:59:49.509795 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a935acad-499d-4a9b-be62-afd2eecdc21a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:49.510414 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a935acad-499d-4a9b-be62-afd2eecdc21a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:49.519154 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a935acad-499d-4a9b-be62-afd2eecdc21a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:49.520005 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a935acad-499d-4a9b-be62-afd2eecdc21a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:49.520674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a935acad-499d-4a9b-be62-afd2eecdc21a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:49.521584 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a935acad-499d-4a9b-be62-afd2eecdc21a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:49.522039 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a935acad-499d-4a9b-be62-afd2eecdc21a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:49.522688 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a935acad-499d-4a9b-be62-afd2eecdc21a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:49.592177 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-a935acad-499d-4a9b-be62-afd2eecdc21a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:49.601995 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a935acad-499d-4a9b-be62-afd2eecdc21a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 200 len: 1613 microversion: 2.1 time: 0.096211 Oct 03 12:59:49.620222 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 476/958] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:49 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 1613 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:49.654250 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-35ada196-e6d6-40ec-a293-00d91ed80a01 req-5009356c-2408-424a-b830-9fb0846793d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6c4b7a-3b99-4a50-9703-a776b7b6b076", "tag": "c76db3b4-ecf1-4866-ba33-9d3ed7d5947b"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:59:49.663382 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-fc4ba3a2-1ff3-4d91-8737-feee031fc14f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:49.664739 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-fc4ba3a2-1ff3-4d91-8737-feee031fc14f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:49.665492 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-35ada196-e6d6-40ec-a293-00d91ed80a01 req-5009356c-2408-424a-b830-9fb0846793d0 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:49.666051 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-35ada196-e6d6-40ec-a293-00d91ed80a01 req-5009356c-2408-424a-b830-9fb0846793d0 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:49.666622 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-35ada196-e6d6-40ec-a293-00d91ed80a01 req-5009356c-2408-424a-b830-9fb0846793d0 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:49.673986 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fc4ba3a2-1ff3-4d91-8737-feee031fc14f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:49.674985 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fc4ba3a2-1ff3-4d91-8737-feee031fc14f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:49.675668 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fc4ba3a2-1ff3-4d91-8737-feee031fc14f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:49.676648 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fc4ba3a2-1ff3-4d91-8737-feee031fc14f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:49.677562 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fc4ba3a2-1ff3-4d91-8737-feee031fc14f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:49.678357 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-fc4ba3a2-1ff3-4d91-8737-feee031fc14f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:49.682537 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-35ada196-e6d6-40ec-a293-00d91ed80a01 req-5009356c-2408-424a-b830-9fb0846793d0 service nova] Creating event network-changed:c76db3b4-ecf1-4866-ba33-9d3ed7d5947b for instance ee6c4b7a-3b99-4a50-9703-a776b7b6b076 on hv-cinder-84456 Oct 03 12:59:49.688564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-35ada196-e6d6-40ec-a293-00d91ed80a01 req-5009356c-2408-424a-b830-9fb0846793d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038705 Oct 03 12:59:49.689954 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 483/959] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:59:49.745991 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-fc4ba3a2-1ff3-4d91-8737-feee031fc14f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Going to try to terminate instance {{(pid=127544) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:59:49.773877 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-deebe2af-9e86-41b4-80ab-0584963f5c12 req-744376e5-c784-47fb-a18d-4eb78a973a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b582d3-a18f-4bed-adf0-5f8107ef89da", "name": "network-vif-deleted", "tag": "4bae14e7-4422-4487-9365-b229427bf0d6"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:59:49.785632 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-deebe2af-9e86-41b4-80ab-0584963f5c12 req-744376e5-c784-47fb-a18d-4eb78a973a79 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:49.786564 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-deebe2af-9e86-41b4-80ab-0584963f5c12 req-744376e5-c784-47fb-a18d-4eb78a973a79 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:49.787162 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-deebe2af-9e86-41b4-80ab-0584963f5c12 req-744376e5-c784-47fb-a18d-4eb78a973a79 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:49.801318 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-deebe2af-9e86-41b4-80ab-0584963f5c12 req-744376e5-c784-47fb-a18d-4eb78a973a79 service nova] Creating event network-vif-deleted:4bae14e7-4422-4487-9365-b229427bf0d6 for instance 77b582d3-a18f-4bed-adf0-5f8107ef89da on hv-cinder-84456 Oct 03 12:59:49.807464 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-deebe2af-9e86-41b4-80ab-0584963f5c12 req-744376e5-c784-47fb-a18d-4eb78a973a79 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042795 Oct 03 12:59:49.810074 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 484/960] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:59:50.158402 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-fc4ba3a2-1ff3-4d91-8737-feee031fc14f tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 204 len: 0 microversion: 2.1 time: 0.500801 Oct 03 12:59:50.160479 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 477/961] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:59:49 2022] DELETE /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:59:50.169157 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1f670b1a-98c2-4318-97f9-60d389d5c03c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:50.169922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-1f670b1a-98c2-4318-97f9-60d389d5c03c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:50.180280 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1f670b1a-98c2-4318-97f9-60d389d5c03c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:50.180778 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1f670b1a-98c2-4318-97f9-60d389d5c03c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:50.181215 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1f670b1a-98c2-4318-97f9-60d389d5c03c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:50.181976 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1f670b1a-98c2-4318-97f9-60d389d5c03c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:50.182427 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1f670b1a-98c2-4318-97f9-60d389d5c03c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:50.182850 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1f670b1a-98c2-4318-97f9-60d389d5c03c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:50.358017 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-1f670b1a-98c2-4318-97f9-60d389d5c03c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:50.364825 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-1f670b1a-98c2-4318-97f9-60d389d5c03c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1575 microversion: 2.1 time: 0.199951 Oct 03 12:59:50.365541 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 485/962] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:50 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1575 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:50.628243 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-047c0294-86ce-45e3-8c9d-c84166488f88 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:50.628964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-047c0294-86ce-45e3-8c9d-c84166488f88 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:50.637962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-047c0294-86ce-45e3-8c9d-c84166488f88 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:50.638462 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-047c0294-86ce-45e3-8c9d-c84166488f88 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:50.638909 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-047c0294-86ce-45e3-8c9d-c84166488f88 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:50.639658 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-047c0294-86ce-45e3-8c9d-c84166488f88 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:50.640119 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-047c0294-86ce-45e3-8c9d-c84166488f88 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:50.640565 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-047c0294-86ce-45e3-8c9d-c84166488f88 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:50.676965 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-047c0294-86ce-45e3-8c9d-c84166488f88 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:50.677466 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-047c0294-86ce-45e3-8c9d-c84166488f88 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:50.677918 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-047c0294-86ce-45e3-8c9d-c84166488f88 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:50.678364 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-047c0294-86ce-45e3-8c9d-c84166488f88 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lazy-loading 'fault' on Instance uuid 77b582d3-a18f-4bed-adf0-5f8107ef89da {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:59:50.725552 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-047c0294-86ce-45e3-8c9d-c84166488f88 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:50.733346 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-047c0294-86ce-45e3-8c9d-c84166488f88 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 200 len: 1331 microversion: 2.1 time: 0.110714 Oct 03 12:59:50.733926 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 478/963] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:50 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:51.389072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-38daa649-93a3-4216-8731-73d3d28a7d83 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:51.389701 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-38daa649-93a3-4216-8731-73d3d28a7d83 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:51.396790 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38daa649-93a3-4216-8731-73d3d28a7d83 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:51.397299 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38daa649-93a3-4216-8731-73d3d28a7d83 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:51.397745 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38daa649-93a3-4216-8731-73d3d28a7d83 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:51.398459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38daa649-93a3-4216-8731-73d3d28a7d83 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:51.398922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38daa649-93a3-4216-8731-73d3d28a7d83 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:51.399382 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-38daa649-93a3-4216-8731-73d3d28a7d83 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:51.549845 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-38daa649-93a3-4216-8731-73d3d28a7d83 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:51.557713 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-38daa649-93a3-4216-8731-73d3d28a7d83 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1575 microversion: 2.1 time: 0.172631 Oct 03 12:59:51.558289 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 486/964] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:51 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:51.757363 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3f2c1702-7b5f-4b41-b330-f4418d0fcd18 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:51.757978 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-3f2c1702-7b5f-4b41-b330-f4418d0fcd18 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:51.760515 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:59:51.765320 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f2c1702-7b5f-4b41-b330-f4418d0fcd18 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:51.765813 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f2c1702-7b5f-4b41-b330-f4418d0fcd18 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:51.766258 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f2c1702-7b5f-4b41-b330-f4418d0fcd18 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:51.766963 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f2c1702-7b5f-4b41-b330-f4418d0fcd18 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:51.767445 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f2c1702-7b5f-4b41-b330-f4418d0fcd18 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:51.767872 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f2c1702-7b5f-4b41-b330-f4418d0fcd18 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:51.808512 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f2c1702-7b5f-4b41-b330-f4418d0fcd18 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:51.808910 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f2c1702-7b5f-4b41-b330-f4418d0fcd18 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:51.809454 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3f2c1702-7b5f-4b41-b330-f4418d0fcd18 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:51.809903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-3f2c1702-7b5f-4b41-b330-f4418d0fcd18 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lazy-loading 'fault' on Instance uuid 77b582d3-a18f-4bed-adf0-5f8107ef89da {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:59:51.853839 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-3f2c1702-7b5f-4b41-b330-f4418d0fcd18 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:51.862860 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-3f2c1702-7b5f-4b41-b330-f4418d0fcd18 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 200 len: 1331 microversion: 2.1 time: 0.109260 Oct 03 12:59:51.863671 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 479/965] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:51 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:52.490282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-b49422f7-bdde-4c04-8cfe-b5eb4b0670c7 req-f55e00e6-cbb2-4461-b5ea-894a1d82e6ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6c4b7a-3b99-4a50-9703-a776b7b6b076", "name": "network-vif-deleted", "tag": "c76db3b4-ecf1-4866-ba33-9d3ed7d5947b"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:59:52.495948 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:59:52.501566 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-b49422f7-bdde-4c04-8cfe-b5eb4b0670c7 req-f55e00e6-cbb2-4461-b5ea-894a1d82e6ba service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:52.502056 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-b49422f7-bdde-4c04-8cfe-b5eb4b0670c7 req-f55e00e6-cbb2-4461-b5ea-894a1d82e6ba service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:52.502494 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-b49422f7-bdde-4c04-8cfe-b5eb4b0670c7 req-f55e00e6-cbb2-4461-b5ea-894a1d82e6ba service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:52.513344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-b49422f7-bdde-4c04-8cfe-b5eb4b0670c7 req-f55e00e6-cbb2-4461-b5ea-894a1d82e6ba service nova] Creating event network-vif-deleted:c76db3b4-ecf1-4866-ba33-9d3ed7d5947b for instance ee6c4b7a-3b99-4a50-9703-a776b7b6b076 on hv-cinder-84456 Oct 03 12:59:52.521455 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-b49422f7-bdde-4c04-8cfe-b5eb4b0670c7 req-f55e00e6-cbb2-4461-b5ea-894a1d82e6ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034804 Oct 03 12:59:52.522071 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 487/966] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:59:52.582861 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b1abbcfb-bd53-4290-87a8-6bc8864ea7e4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:52.583590 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-b1abbcfb-bd53-4290-87a8-6bc8864ea7e4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:52.589462 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b1abbcfb-bd53-4290-87a8-6bc8864ea7e4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:52.589949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b1abbcfb-bd53-4290-87a8-6bc8864ea7e4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:52.590387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b1abbcfb-bd53-4290-87a8-6bc8864ea7e4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:52.591083 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b1abbcfb-bd53-4290-87a8-6bc8864ea7e4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:52.591563 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b1abbcfb-bd53-4290-87a8-6bc8864ea7e4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:52.591992 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-b1abbcfb-bd53-4290-87a8-6bc8864ea7e4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:52.652995 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-b1abbcfb-bd53-4290-87a8-6bc8864ea7e4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:52.660799 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-b1abbcfb-bd53-4290-87a8-6bc8864ea7e4 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1390 microversion: 2.1 time: 0.083111 Oct 03 12:59:52.661376 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 480/967] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:52 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:59:52.886865 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-330db6ad-8635-49c7-8259-f6567dd1f1f0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:52.887639 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-330db6ad-8635-49c7-8259-f6567dd1f1f0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:52.895127 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-330db6ad-8635-49c7-8259-f6567dd1f1f0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:52.895647 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-330db6ad-8635-49c7-8259-f6567dd1f1f0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:52.896089 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-330db6ad-8635-49c7-8259-f6567dd1f1f0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:52.896801 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-330db6ad-8635-49c7-8259-f6567dd1f1f0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:52.897259 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-330db6ad-8635-49c7-8259-f6567dd1f1f0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:52.897689 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-330db6ad-8635-49c7-8259-f6567dd1f1f0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:52.911612 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-330db6ad-8635-49c7-8259-f6567dd1f1f0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] HTTP exception thrown: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-330db6ad-8635-49c7-8259-f6567dd1f1f0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Request method failure captured: Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da HTTP/1.1 Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtv1CNm_b3zyY3l-zqVpZ2PQwqysRe2xnTgm3TNFdQ3cxiuS5j1-KWYI4GxOIqIjyZXbTsRo_o30sxOzEi3tD56qI7VaNvXIBy0ny91RFTfbOk3WiMgFKVlDpWGpK6dHDg9Zbd0fRbIxhEH2S7Uy_tqxJtEm9mgtQiU5SFB6-mN0xzA Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 484522301976426dae50e64c141c727e Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:59:52.913126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:59:52.914749 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_484522301976426dae50e64c141c727e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/484522301976426dae50e64c141c727e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:59:52.914749 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-AttachVolumeNegativeTest-37738108 Oct 03 12:59:52.914749 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 484522301976426dae50e64c141c727e Oct 03 12:59:52.914749 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 12:59:52.914749 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 12:59:52.914749 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:59:52.914749 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:59:52.914749 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 5e29a4c0276247c286cff3eed5a1253a Oct 03 12:59:52.914749 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 12:59:52.914749 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:59:52.914749 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. Oct 03 12:59:52.914749 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': '77b582d3-a18f-4bed-adf0-5f8107ef89da'} Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:59:52.915858 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. Oct 03 12:59:52.917371 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:59:52.918874 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-330db6ad-8635-49c7-8259-f6567dd1f1f0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Returning 404 to user: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:59:52.918874 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-330db6ad-8635-49c7-8259-f6567dd1f1f0 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 404 len: 111 microversion: 2.1 time: 0.032071 Oct 03 12:59:52.918874 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 488/968] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:52 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:59:52.924608 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9a97d909-59a6-49d6-8850-c3eff03407b5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '.version_select at 0x7fc7401ba3a0>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:53.019679 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-9a97d909-59a6-49d6-8850-c3eff03407b5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-245205535" status: 202 len: 0 microversion: 2.1 time: 0.099235 Oct 03 12:59:53.020273 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 481/969] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Oct 3 12:59:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-245205535 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:59:53.684259 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a401f223-3899-4259-bbb0-24107c4f2fa1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:53.684953 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a401f223-3899-4259-bbb0-24107c4f2fa1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:53.693152 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a401f223-3899-4259-bbb0-24107c4f2fa1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:53.693683 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a401f223-3899-4259-bbb0-24107c4f2fa1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:53.694129 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a401f223-3899-4259-bbb0-24107c4f2fa1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:53.694878 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a401f223-3899-4259-bbb0-24107c4f2fa1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:53.695575 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a401f223-3899-4259-bbb0-24107c4f2fa1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:53.696199 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a401f223-3899-4259-bbb0-24107c4f2fa1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:53.732192 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a401f223-3899-4259-bbb0-24107c4f2fa1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:53.732597 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a401f223-3899-4259-bbb0-24107c4f2fa1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:53.733096 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a401f223-3899-4259-bbb0-24107c4f2fa1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:53.733547 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-a401f223-3899-4259-bbb0-24107c4f2fa1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lazy-loading 'fault' on Instance uuid ee6c4b7a-3b99-4a50-9703-a776b7b6b076 {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:59:53.782921 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a401f223-3899-4259-bbb0-24107c4f2fa1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:53.784548 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ae9ec440-5300-4855-ae10-f1230c407ed5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Action: 'create', calling method: .version_select at 0x7fc743a40ca0>, body: {"keypair": {"name": "tempest-keypair-459579982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxnsHzohCO+fuhDuIm9Jd86HYvef/iSRgMmCRSYmTmtvpGEmurPnE04ytjtmEMWl1F5zvF0/Qb34l6dGDHrC6TV9ie0Qv1/2MPePYRzqGr3pYAolUgQHmbt+A7w/4IqoQ=="}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:59:53.792333 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a401f223-3899-4259-bbb0-24107c4f2fa1 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 200 len: 1184 microversion: 2.1 time: 0.112037 Oct 03 12:59:53.794233 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 489/970] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:53 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 1184 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:53.801853 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-ae9ec440-5300-4855-ae10-f1230c407ed5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Getting quotas for project 484522301976426dae50e64c141c727e. Resources: {'key_pairs'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:59:53.805801 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-ae9ec440-5300-4855-ae10-f1230c407ed5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Getting quotas for user 5e29a4c0276247c286cff3eed5a1253a and project 484522301976426dae50e64c141c727e. Resources: {'key_pairs'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:59:53.860287 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ae9ec440-5300-4855-ae10-f1230c407ed5 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.079479 Oct 03 12:59:53.860887 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 482/971] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 12:59:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:59:54.816869 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4b0b89e8-d64e-43ff-ab74-dc49650c3b3c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:54.817495 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-4b0b89e8-d64e-43ff-ab74-dc49650c3b3c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: ee6c4b7a-3b99-4a50-9703-a776b7b6b076] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:54.823994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b0b89e8-d64e-43ff-ab74-dc49650c3b3c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:54.824485 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b0b89e8-d64e-43ff-ab74-dc49650c3b3c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:54.827121 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b0b89e8-d64e-43ff-ab74-dc49650c3b3c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:54.827121 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b0b89e8-d64e-43ff-ab74-dc49650c3b3c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:54.827121 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b0b89e8-d64e-43ff-ab74-dc49650c3b3c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:54.827121 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-4b0b89e8-d64e-43ff-ab74-dc49650c3b3c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:54.839693 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-4b0b89e8-d64e-43ff-ab74-dc49650c3b3c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] HTTP exception thrown: Instance ee6c4b7a-3b99-4a50-9703-a776b7b6b076 could not be found. Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4b0b89e8-d64e-43ff-ab74-dc49650c3b3c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Request method failure captured: Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 HTTP/1.1 Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtrf71VhcaY_BRgY09rn0Fziy7wn5zvqq7Sl8w3d-pKgYE-iVsAEtAdWeB672MRu6Lj9k4L2KiqNiPpLYnBcyDEyKIewqW3G00eAeBGwM_xApGSar36v-W3E_-BHmWMdmz_Q7eBKs4c3wLUJgtuRau-8AFYp9P52SyX-QwaxLcU8tsE Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 38d1778202d041b58934150c6af9685c Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-TestVolumeBootPattern-24941892 Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 12:59:54.841202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 12:59:54.842842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38d1778202d041b58934150c6af9685c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d1778202d041b58934150c6af9685c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d1778202d041b58934150c6af9685c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38d1778202d041b58934150c6af9685c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 12:59:54.842842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-TestVolumeBootPattern-24941892 Oct 03 12:59:54.842842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 38d1778202d041b58934150c6af9685c Oct 03 12:59:54.842842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-TestVolumeBootPattern-24941892 Oct 03 12:59:54.842842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-TestVolumeBootPattern-24941892-project Oct 03 12:59:54.842842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 12:59:54.842842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 12:59:54.842842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 7ffffa27986f461ebc10c23c3c9817f0 Oct 03 12:59:54.842842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-TestVolumeBootPattern-24941892-project Oct 03 12:59:54.842842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 12:59:54.842842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance ee6c4b7a-3b99-4a50-9703-a776b7b6b076 could not be found. Oct 03 12:59:54.842842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': 'ee6c4b7a-3b99-4a50-9703-a776b7b6b076'} Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6c4b7a-3b99-4a50-9703-a776b7b6b076 could not be found. Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:59:54.843702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6c4b7a-3b99-4a50-9703-a776b7b6b076 could not be found. Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6c4b7a-3b99-4a50-9703-a776b7b6b076 could not be found. Oct 03 12:59:54.845579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 12:59:54.846682 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4b0b89e8-d64e-43ff-ab74-dc49650c3b3c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Returning 404 to user: Instance ee6c4b7a-3b99-4a50-9703-a776b7b6b076 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:59:54.846682 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-4b0b89e8-d64e-43ff-ab74-dc49650c3b3c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076" status: 404 len: 111 microversion: 2.1 time: 0.029699 Oct 03 12:59:54.846682 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 490/972] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:54 2022] GET /compute/v2.1/servers/ee6c4b7a-3b99-4a50-9703-a776b7b6b076 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:59:56.054366 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1952924374", "imageRef": "9d585789-e496-433d-b311-70ec7ceffd99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c116e69-b6ec-41cd-b2b6-637e304e9d46"}], "security_groups": [{"name": "tempest-securitygroup--432955923"}], "key_name": "tempest-keypair-459579982", "user_data": "}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:59:56.064452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=2 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:59:56.177236 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.network.neutron [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] validate_networks() for [('1c116e69-b6ec-41cd-b2b6-637e304e9d46', None, None, None, None, None)] {{(pid=127544) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:59:56.562760 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Flavor limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:59:56.563187 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Image limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:59:56.563700 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Flavor pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:59:56.564113 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Image pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:59:56.564526 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:59:56.573086 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:56.576319 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:56.576319 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:56.576319 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:56.576319 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:56.576815 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:56.592432 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Getting quotas for project 484522301976426dae50e64c141c727e. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:59:56.597222 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Getting quotas for user 5e29a4c0276247c286cff3eed5a1253a and project 484522301976426dae50e64c141c727e. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:59:56.608164 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Going to run 1 instances... {{(pid=127544) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:59:56.610756 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d585789-e496-433d-b311-70ec7ceffd99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:59:56.735905 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-05b6050f-53b3-4bc7-a1d0-619f9f16762b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.685930 Oct 03 12:59:56.736565 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 483/973] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 12:59:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:59:56.748372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-65a94e12-b084-491e-b307-eb671f7bb517 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:56.748993 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-65a94e12-b084-491e-b307-eb671f7bb517 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:56.825371 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-14f92ac4-0311-46b7-816b-8eaee4dde150 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:56.825994 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-14f92ac4-0311-46b7-816b-8eaee4dde150 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:56.826793 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-65a94e12-b084-491e-b307-eb671f7bb517 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:56.834412 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-14f92ac4-0311-46b7-816b-8eaee4dde150 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:56.834902 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-14f92ac4-0311-46b7-816b-8eaee4dde150 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:56.835361 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-14f92ac4-0311-46b7-816b-8eaee4dde150 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:56.835607 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-65a94e12-b084-491e-b307-eb671f7bb517 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 200 len: 1241 microversion: 2.1 time: 0.091449 Oct 03 12:59:56.836067 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-14f92ac4-0311-46b7-816b-8eaee4dde150 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:56.836343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 491/974] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:56 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:56.843620 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-14f92ac4-0311-46b7-816b-8eaee4dde150 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:56.844806 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-14f92ac4-0311-46b7-816b-8eaee4dde150 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:56.989502 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-14f92ac4-0311-46b7-816b-8eaee4dde150 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:56.998015 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-14f92ac4-0311-46b7-816b-8eaee4dde150 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1595 microversion: 2.1 time: 0.177037 Oct 03 12:59:56.998586 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 484/975] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:56 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1595 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:57.858781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3c665a1c-1129-4fcf-bf3a-de155a98da73 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:57.861347 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3c665a1c-1129-4fcf-bf3a-de155a98da73 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:57.870185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c665a1c-1129-4fcf-bf3a-de155a98da73 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:57.871359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c665a1c-1129-4fcf-bf3a-de155a98da73 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:57.871968 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c665a1c-1129-4fcf-bf3a-de155a98da73 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:57.872894 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c665a1c-1129-4fcf-bf3a-de155a98da73 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:57.873585 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c665a1c-1129-4fcf-bf3a-de155a98da73 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:57.874199 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3c665a1c-1129-4fcf-bf3a-de155a98da73 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:57.986074 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3c665a1c-1129-4fcf-bf3a-de155a98da73 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:57.994852 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3c665a1c-1129-4fcf-bf3a-de155a98da73 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 200 len: 1237 microversion: 2.1 time: 0.140253 Oct 03 12:59:58.007359 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 492/976] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:57 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 1237 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:58.264390 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-1821a681-bea9-4159-a5aa-420f67fa869b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:58.264932 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-1821a681-bea9-4159-a5aa-420f67fa869b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:58.268344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-d92ee404-9bc3-4307-b8b9-1bd5ddafacc6 req-5937e909-ae49-41fb-be67-b1ff7be8607d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0ce55bf-3f09-490a-baf4-0822672b5805", "tag": "e0d4db50-7910-4292-8ab0-c965757c89d7"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:59:58.278662 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1821a681-bea9-4159-a5aa-420f67fa869b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:58.278958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-d92ee404-9bc3-4307-b8b9-1bd5ddafacc6 req-5937e909-ae49-41fb-be67-b1ff7be8607d service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:58.279157 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1821a681-bea9-4159-a5aa-420f67fa869b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:58.279635 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1821a681-bea9-4159-a5aa-420f67fa869b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:58.279784 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-d92ee404-9bc3-4307-b8b9-1bd5ddafacc6 req-5937e909-ae49-41fb-be67-b1ff7be8607d service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:58.280225 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-d92ee404-9bc3-4307-b8b9-1bd5ddafacc6 req-5937e909-ae49-41fb-be67-b1ff7be8607d service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:58.280374 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1821a681-bea9-4159-a5aa-420f67fa869b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:58.280794 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1821a681-bea9-4159-a5aa-420f67fa869b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:58.281221 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1821a681-bea9-4159-a5aa-420f67fa869b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:58.298949 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-d92ee404-9bc3-4307-b8b9-1bd5ddafacc6 req-5937e909-ae49-41fb-be67-b1ff7be8607d service nova] Creating event network-changed:e0d4db50-7910-4292-8ab0-c965757c89d7 for instance b0ce55bf-3f09-490a-baf4-0822672b5805 on hv-cinder-84456 Oct 03 12:59:58.305313 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-d92ee404-9bc3-4307-b8b9-1bd5ddafacc6 req-5937e909-ae49-41fb-be67-b1ff7be8607d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041970 Oct 03 12:59:58.306517 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 493/977] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:59:58.315344 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-1821a681-bea9-4159-a5aa-420f67fa869b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Going to try to terminate instance {{(pid=127544) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:59:58.613824 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-1821a681-bea9-4159-a5aa-420f67fa869b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 204 len: 0 microversion: 2.1 time: 0.352942 Oct 03 12:59:58.614344 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 485/978] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 12:59:58 2022] DELETE /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:59:58.624129 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c4cf8364-c8da-4e62-8bd9-834ed2ed1b7c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:58.624846 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c4cf8364-c8da-4e62-8bd9-834ed2ed1b7c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:58.631776 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4cf8364-c8da-4e62-8bd9-834ed2ed1b7c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:58.632490 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4cf8364-c8da-4e62-8bd9-834ed2ed1b7c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:58.633716 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4cf8364-c8da-4e62-8bd9-834ed2ed1b7c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:58.634080 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4cf8364-c8da-4e62-8bd9-834ed2ed1b7c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:58.634753 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4cf8364-c8da-4e62-8bd9-834ed2ed1b7c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:58.635363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c4cf8364-c8da-4e62-8bd9-834ed2ed1b7c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:58.885633 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c4cf8364-c8da-4e62-8bd9-834ed2ed1b7c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:58.894557 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c4cf8364-c8da-4e62-8bd9-834ed2ed1b7c tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1575 microversion: 2.1 time: 0.275164 Oct 03 12:59:58.895140 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 494/979] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:58 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1575 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:59.032536 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d22169ca-7f10-414b-81c9-cc3cf44e3070 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:59.033249 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d22169ca-7f10-414b-81c9-cc3cf44e3070 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:59.039547 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d22169ca-7f10-414b-81c9-cc3cf44e3070 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:59.040045 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d22169ca-7f10-414b-81c9-cc3cf44e3070 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:59.040675 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d22169ca-7f10-414b-81c9-cc3cf44e3070 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:59.041183 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d22169ca-7f10-414b-81c9-cc3cf44e3070 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:59.041646 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d22169ca-7f10-414b-81c9-cc3cf44e3070 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:59.042138 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d22169ca-7f10-414b-81c9-cc3cf44e3070 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:59.134331 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d22169ca-7f10-414b-81c9-cc3cf44e3070 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:59:59.142731 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d22169ca-7f10-414b-81c9-cc3cf44e3070 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 200 len: 1301 microversion: 2.1 time: 0.115233 Oct 03 12:59:59.149068 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 486/980] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:59 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 1301 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:59:59.615609 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-7a89d49c-eca2-4e42-a9e4-8327b8b79d42 req-3bc5d5e3-dd9b-4a2a-a5ef-b4cb4cc115a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "229aaf8a-e3ce-4319-94b4-7e22662880b3", "tag": "f317c1e2-f283-4fec-bf28-0094dfcd58ff"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:59:59.626949 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-7a89d49c-eca2-4e42-a9e4-8327b8b79d42 req-3bc5d5e3-dd9b-4a2a-a5ef-b4cb4cc115a4 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:59.627710 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-7a89d49c-eca2-4e42-a9e4-8327b8b79d42 req-3bc5d5e3-dd9b-4a2a-a5ef-b4cb4cc115a4 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:59.628301 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-7a89d49c-eca2-4e42-a9e4-8327b8b79d42 req-3bc5d5e3-dd9b-4a2a-a5ef-b4cb4cc115a4 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:59.640399 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-7a89d49c-eca2-4e42-a9e4-8327b8b79d42 req-3bc5d5e3-dd9b-4a2a-a5ef-b4cb4cc115a4 service nova] Creating event network-changed:f317c1e2-f283-4fec-bf28-0094dfcd58ff for instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 on hv-cinder-84456 Oct 03 12:59:59.645476 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-7a89d49c-eca2-4e42-a9e4-8327b8b79d42 req-3bc5d5e3-dd9b-4a2a-a5ef-b4cb4cc115a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033512 Oct 03 12:59:59.646074 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 495/981] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 12:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:59:59.918370 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-51a482c1-12ac-43e1-a206-866512379c82 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:59:59.918991 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-51a482c1-12ac-43e1-a206-866512379c82 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:59:59.927223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-51a482c1-12ac-43e1-a206-866512379c82 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:59.928552 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-51a482c1-12ac-43e1-a206-866512379c82 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:59.928552 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-51a482c1-12ac-43e1-a206-866512379c82 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:59:59.929500 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-51a482c1-12ac-43e1-a206-866512379c82 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:59:59.929959 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-51a482c1-12ac-43e1-a206-866512379c82 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:59:59.930391 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-51a482c1-12ac-43e1-a206-866512379c82 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:00.169704 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-740baeed-d48f-46c5-b1e9-8791a0996d10 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:00.171191 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-740baeed-d48f-46c5-b1e9-8791a0996d10 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:00.181620 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-740baeed-d48f-46c5-b1e9-8791a0996d10 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:00.182328 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-740baeed-d48f-46c5-b1e9-8791a0996d10 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:00.183635 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-740baeed-d48f-46c5-b1e9-8791a0996d10 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:00.184521 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-740baeed-d48f-46c5-b1e9-8791a0996d10 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:00.185138 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-740baeed-d48f-46c5-b1e9-8791a0996d10 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:00.185855 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-740baeed-d48f-46c5-b1e9-8791a0996d10 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:00.298097 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-51a482c1-12ac-43e1-a206-866512379c82 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:00.308780 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-51a482c1-12ac-43e1-a206-866512379c82 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1575 microversion: 2.1 time: 0.394242 Oct 03 13:00:00.314763 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 487/982] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 12:59:59 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1575 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:00.332752 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-740baeed-d48f-46c5-b1e9-8791a0996d10 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:00.349785 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-740baeed-d48f-46c5-b1e9-8791a0996d10 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 200 len: 1311 microversion: 2.1 time: 0.186492 Oct 03 13:00:00.350592 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 496/983] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:00 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 1311 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:00:01.279476 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-2180a23c-0571-4fa0-8460-cd45065e8832 req-f20eff31-7ae1-45ba-bc49-4536120b3c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0ce55bf-3f09-490a-baf4-0822672b5805", "name": "network-vif-deleted", "tag": "e0d4db50-7910-4292-8ab0-c965757c89d7"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:00:01.301089 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-2180a23c-0571-4fa0-8460-cd45065e8832 req-f20eff31-7ae1-45ba-bc49-4536120b3c22 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:01.301581 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-2180a23c-0571-4fa0-8460-cd45065e8832 req-f20eff31-7ae1-45ba-bc49-4536120b3c22 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:01.302050 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-2180a23c-0571-4fa0-8460-cd45065e8832 req-f20eff31-7ae1-45ba-bc49-4536120b3c22 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:01.315217 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-2180a23c-0571-4fa0-8460-cd45065e8832 req-f20eff31-7ae1-45ba-bc49-4536120b3c22 service nova] Creating event network-vif-deleted:e0d4db50-7910-4292-8ab0-c965757c89d7 for instance b0ce55bf-3f09-490a-baf4-0822672b5805 on hv-cinder-84456 Oct 03 13:00:01.320134 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-2180a23c-0571-4fa0-8460-cd45065e8832 req-f20eff31-7ae1-45ba-bc49-4536120b3c22 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115549 Oct 03 13:00:01.321631 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 488/984] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 13:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:00:01.335678 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-a7ae8e4b-172c-4b14-b93f-e1a01919bd1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:01.336733 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-a7ae8e4b-172c-4b14-b93f-e1a01919bd1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:01.343117 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a7ae8e4b-172c-4b14-b93f-e1a01919bd1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:01.343794 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a7ae8e4b-172c-4b14-b93f-e1a01919bd1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:01.344326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a7ae8e4b-172c-4b14-b93f-e1a01919bd1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:01.345047 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a7ae8e4b-172c-4b14-b93f-e1a01919bd1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:01.345509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a7ae8e4b-172c-4b14-b93f-e1a01919bd1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:01.345972 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-a7ae8e4b-172c-4b14-b93f-e1a01919bd1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:01.395091 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d54e6c84-c8a7-415e-97ce-8c96e04434b1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:01.397859 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d54e6c84-c8a7-415e-97ce-8c96e04434b1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:01.414767 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d54e6c84-c8a7-415e-97ce-8c96e04434b1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:01.415269 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d54e6c84-c8a7-415e-97ce-8c96e04434b1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:01.415739 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d54e6c84-c8a7-415e-97ce-8c96e04434b1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:01.416629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d54e6c84-c8a7-415e-97ce-8c96e04434b1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:01.417109 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d54e6c84-c8a7-415e-97ce-8c96e04434b1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:01.417542 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d54e6c84-c8a7-415e-97ce-8c96e04434b1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:01.443899 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-a7ae8e4b-172c-4b14-b93f-e1a01919bd1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:01.456486 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-a7ae8e4b-172c-4b14-b93f-e1a01919bd1b tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1224 microversion: 2.1 time: 0.124866 Oct 03 13:00:01.457254 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 497/985] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:01 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1224 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:01.488993 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d54e6c84-c8a7-415e-97ce-8c96e04434b1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:01.491364 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:00:01.498324 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d54e6c84-c8a7-415e-97ce-8c96e04434b1 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 200 len: 1299 microversion: 2.1 time: 0.125963 Oct 03 13:00:01.499206 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 489/986] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:01 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:02.483704 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-52118cf3-cecb-48f1-abdf-f8f71acabb09 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:02.484968 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-52118cf3-cecb-48f1-abdf-f8f71acabb09 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:02.492348 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-52118cf3-cecb-48f1-abdf-f8f71acabb09 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:02.492899 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-52118cf3-cecb-48f1-abdf-f8f71acabb09 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:02.495472 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-52118cf3-cecb-48f1-abdf-f8f71acabb09 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:02.495472 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-52118cf3-cecb-48f1-abdf-f8f71acabb09 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:02.495472 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-52118cf3-cecb-48f1-abdf-f8f71acabb09 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:02.495472 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-52118cf3-cecb-48f1-abdf-f8f71acabb09 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:02.522410 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-ea83b4d5-32e3-445a-8a48-0dfd5fa9f379 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:02.524078 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-ea83b4d5-32e3-445a-8a48-0dfd5fa9f379 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:02.530322 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ea83b4d5-32e3-445a-8a48-0dfd5fa9f379 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:02.530809 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ea83b4d5-32e3-445a-8a48-0dfd5fa9f379 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:02.531249 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ea83b4d5-32e3-445a-8a48-0dfd5fa9f379 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:02.531965 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ea83b4d5-32e3-445a-8a48-0dfd5fa9f379 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:02.532417 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ea83b4d5-32e3-445a-8a48-0dfd5fa9f379 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:02.532847 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-ea83b4d5-32e3-445a-8a48-0dfd5fa9f379 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:02.548698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-52118cf3-cecb-48f1-abdf-f8f71acabb09 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:02.549182 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-52118cf3-cecb-48f1-abdf-f8f71acabb09 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:02.549797 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-52118cf3-cecb-48f1-abdf-f8f71acabb09 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:02.550407 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-52118cf3-cecb-48f1-abdf-f8f71acabb09 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lazy-loading 'fault' on Instance uuid b0ce55bf-3f09-490a-baf4-0822672b5805 {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:00:02.628514 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-52118cf3-cecb-48f1-abdf-f8f71acabb09 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffffa27986f461ebc10c23c3c9817f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1778202d041b58934150c6af9685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:02.637107 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-52118cf3-cecb-48f1-abdf-f8f71acabb09 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 200 len: 1183 microversion: 2.1 time: 0.159013 Oct 03 13:00:02.647742 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 498/987] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:02 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 1183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:02.727877 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-ea83b4d5-32e3-445a-8a48-0dfd5fa9f379 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:02.736164 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-ea83b4d5-32e3-445a-8a48-0dfd5fa9f379 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 200 len: 1366 microversion: 2.1 time: 0.217572 Oct 03 13:00:02.736711 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 490/988] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:02 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:00:03.252038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1ac9d79d-73b3-46b1-8ed5-fb27b9e6c3b8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1179058255"}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:00:03.252580 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-1ac9d79d-73b3-46b1-8ed5-fb27b9e6c3b8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:03.258500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1ac9d79d-73b3-46b1-8ed5-fb27b9e6c3b8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:03.258985 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1ac9d79d-73b3-46b1-8ed5-fb27b9e6c3b8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:03.259463 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1ac9d79d-73b3-46b1-8ed5-fb27b9e6c3b8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:03.260151 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1ac9d79d-73b3-46b1-8ed5-fb27b9e6c3b8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:03.260604 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1ac9d79d-73b3-46b1-8ed5-fb27b9e6c3b8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:03.261027 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1ac9d79d-73b3-46b1-8ed5-fb27b9e6c3b8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:03.335382 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-742001d7-0d22-4c2d-8dbc-ccd1d16928f7 req-49e235d1-4473-47d0-b5a4-bc2a037860a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c0a1aa2-1890-4062-bec7-6ab15fe3a595", "tag": "68c75d66-fabb-4d68-9545-0cf165338459"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:00:03.346532 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-742001d7-0d22-4c2d-8dbc-ccd1d16928f7 req-49e235d1-4473-47d0-b5a4-bc2a037860a7 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:03.347105 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-742001d7-0d22-4c2d-8dbc-ccd1d16928f7 req-49e235d1-4473-47d0-b5a4-bc2a037860a7 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:03.347665 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-742001d7-0d22-4c2d-8dbc-ccd1d16928f7 req-49e235d1-4473-47d0-b5a4-bc2a037860a7 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:03.358675 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-742001d7-0d22-4c2d-8dbc-ccd1d16928f7 req-49e235d1-4473-47d0-b5a4-bc2a037860a7 service nova] Creating event network-changed:68c75d66-fabb-4d68-9545-0cf165338459 for instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 on hv-cinder-84456 Oct 03 13:00:03.364599 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-742001d7-0d22-4c2d-8dbc-ccd1d16928f7 req-49e235d1-4473-47d0-b5a4-bc2a037860a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032908 Oct 03 13:00:03.365909 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 491/989] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 13:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:00:03.406129 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.network.security_group_api [None req-1ac9d79d-73b3-46b1-8ed5-fb27b9e6c3b8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Adding security group 5151003a-5cd5-408f-adba-43e6814f5c12 to port f317c1e2-f283-4fec-bf28-0094dfcd58ff Oct 03 13:00:03.661940 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-036eb4db-d34a-4ff1-9499-ef90015a7390 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:03.662664 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-036eb4db-d34a-4ff1-9499-ef90015a7390 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: b0ce55bf-3f09-490a-baf4-0822672b5805] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:03.669036 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-036eb4db-d34a-4ff1-9499-ef90015a7390 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:03.669589 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-036eb4db-d34a-4ff1-9499-ef90015a7390 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:03.670028 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-036eb4db-d34a-4ff1-9499-ef90015a7390 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:03.671112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-036eb4db-d34a-4ff1-9499-ef90015a7390 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:03.671598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-036eb4db-d34a-4ff1-9499-ef90015a7390 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:03.672086 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-036eb4db-d34a-4ff1-9499-ef90015a7390 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:03.689286 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-036eb4db-d34a-4ff1-9499-ef90015a7390 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] HTTP exception thrown: Instance b0ce55bf-3f09-490a-baf4-0822672b5805 could not be found. Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-036eb4db-d34a-4ff1-9499-ef90015a7390 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Request method failure captured: Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 HTTP/1.1 Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtrf71VhcaY_BRgY09rn0Fziy7wn5zvqq7Sl8w3d-pKgYE-iVsAEtAdWeB672MRu6Lj9k4L2KiqNiPpLYnBcyDEyKIewqW3G00eAeBGwM_xApGSar36v-W3E_-BHmWMdmz_Q7eBKs4c3wLUJgtuRau-8AFYp9P52SyX-QwaxLcU8tsE Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: 38d1778202d041b58934150c6af9685c Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-TestVolumeBootPattern-24941892 Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 13:00:03.691176 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 13:00:03.692946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38d1778202d041b58934150c6af9685c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d1778202d041b58934150c6af9685c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d1778202d041b58934150c6af9685c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38d1778202d041b58934150c6af9685c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:00:03.692946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-TestVolumeBootPattern-24941892 Oct 03 13:00:03.692946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: 38d1778202d041b58934150c6af9685c Oct 03 13:00:03.692946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-TestVolumeBootPattern-24941892 Oct 03 13:00:03.692946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-TestVolumeBootPattern-24941892-project Oct 03 13:00:03.692946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 13:00:03.692946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 13:00:03.692946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: 7ffffa27986f461ebc10c23c3c9817f0 Oct 03 13:00:03.692946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-TestVolumeBootPattern-24941892-project Oct 03 13:00:03.692946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 13:00:03.692946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Instance b0ce55bf-3f09-490a-baf4-0822672b5805 could not be found. Oct 03 13:00:03.692946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': 'b0ce55bf-3f09-490a-baf4-0822672b5805'} Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0ce55bf-3f09-490a-baf4-0822672b5805 could not be found. Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:00:03.693949 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0ce55bf-3f09-490a-baf4-0822672b5805 could not be found. Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0ce55bf-3f09-490a-baf4-0822672b5805 could not be found. Oct 03 13:00:03.695493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:00:03.696989 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-036eb4db-d34a-4ff1-9499-ef90015a7390 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Returning 404 to user: Instance b0ce55bf-3f09-490a-baf4-0822672b5805 could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:00:03.696989 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-036eb4db-d34a-4ff1-9499-ef90015a7390 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805" status: 404 len: 111 microversion: 2.1 time: 0.039539 Oct 03 13:00:03.698512 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 492/990] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:03 2022] GET /compute/v2.1/servers/b0ce55bf-3f09-490a-baf4-0822672b5805 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 13:00:03.759550 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8c06d76b-56eb-4f6a-93ba-3ce76ac89bda tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:03.760274 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-8c06d76b-56eb-4f6a-93ba-3ce76ac89bda tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:03.766823 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8c06d76b-56eb-4f6a-93ba-3ce76ac89bda tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:03.767425 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8c06d76b-56eb-4f6a-93ba-3ce76ac89bda tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:03.767870 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8c06d76b-56eb-4f6a-93ba-3ce76ac89bda tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:03.768566 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8c06d76b-56eb-4f6a-93ba-3ce76ac89bda tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:03.769021 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8c06d76b-56eb-4f6a-93ba-3ce76ac89bda tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:03.769447 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-8c06d76b-56eb-4f6a-93ba-3ce76ac89bda tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:03.829776 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-1ac9d79d-73b3-46b1-8ed5-fb27b9e6c3b8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "POST /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3/action" status: 202 len: 0 microversion: 2.1 time: 0.579878 Oct 03 13:00:03.831761 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 499/991] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 13:00:03 2022] POST /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 13:00:03.841216 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-85f3dd45-5623-40cc-89c1-fa9ac67f637b req-7616f137-063f-4348-adb3-a75fc569ca71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "229aaf8a-e3ce-4319-94b4-7e22662880b3", "tag": "f317c1e2-f283-4fec-bf28-0094dfcd58ff"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:00:03.855864 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-85f3dd45-5623-40cc-89c1-fa9ac67f637b req-7616f137-063f-4348-adb3-a75fc569ca71 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:03.856745 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-85f3dd45-5623-40cc-89c1-fa9ac67f637b req-7616f137-063f-4348-adb3-a75fc569ca71 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:03.857435 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-85f3dd45-5623-40cc-89c1-fa9ac67f637b req-7616f137-063f-4348-adb3-a75fc569ca71 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:03.877644 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-85f3dd45-5623-40cc-89c1-fa9ac67f637b req-7616f137-063f-4348-adb3-a75fc569ca71 service nova] Creating event network-changed:f317c1e2-f283-4fec-bf28-0094dfcd58ff for instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 on hv-cinder-84456 Oct 03 13:00:03.885543 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-85f3dd45-5623-40cc-89c1-fa9ac67f637b req-7616f137-063f-4348-adb3-a75fc569ca71 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051060 Oct 03 13:00:03.889392 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 500/992] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 13:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:00:03.908424 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-cc0ffb99-dbe3-4c32-8c73-e7c878e54c51 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:03.912513 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-cc0ffb99-dbe3-4c32-8c73-e7c878e54c51 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:03.929363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc0ffb99-dbe3-4c32-8c73-e7c878e54c51 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:03.929931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc0ffb99-dbe3-4c32-8c73-e7c878e54c51 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:03.930373 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc0ffb99-dbe3-4c32-8c73-e7c878e54c51 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:03.931426 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc0ffb99-dbe3-4c32-8c73-e7c878e54c51 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:03.931928 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc0ffb99-dbe3-4c32-8c73-e7c878e54c51 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:03.932400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-cc0ffb99-dbe3-4c32-8c73-e7c878e54c51 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:04.009357 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-8c06d76b-56eb-4f6a-93ba-3ce76ac89bda tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:04.024025 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-8c06d76b-56eb-4f6a-93ba-3ce76ac89bda tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 200 len: 1366 microversion: 2.1 time: 0.268196 Oct 03 13:00:04.034124 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 493/993] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:03 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:00:04.129015 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-cc0ffb99-dbe3-4c32-8c73-e7c878e54c51 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:04.132939 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:00:04.138402 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-cc0ffb99-dbe3-4c32-8c73-e7c878e54c51 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1761 microversion: 2.1 time: 0.244213 Oct 03 13:00:04.144074 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 501/994] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:03 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1761 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:05.048856 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-db824ba9-4e92-428d-968a-8a99646661ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:05.049474 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-db824ba9-4e92-428d-968a-8a99646661ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:05.055777 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-db824ba9-4e92-428d-968a-8a99646661ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:05.056374 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-db824ba9-4e92-428d-968a-8a99646661ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:05.056818 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-db824ba9-4e92-428d-968a-8a99646661ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:05.057508 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-db824ba9-4e92-428d-968a-8a99646661ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:05.057979 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-db824ba9-4e92-428d-968a-8a99646661ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:05.058381 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-db824ba9-4e92-428d-968a-8a99646661ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:05.124869 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-746a5d7d-65fa-4e17-baf9-bede75047e0a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:05.126855 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-746a5d7d-65fa-4e17-baf9-bede75047e0a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:05.133878 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-746a5d7d-65fa-4e17-baf9-bede75047e0a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:05.134368 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-746a5d7d-65fa-4e17-baf9-bede75047e0a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:05.134800 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-746a5d7d-65fa-4e17-baf9-bede75047e0a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:05.135529 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-746a5d7d-65fa-4e17-baf9-bede75047e0a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:05.135988 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-746a5d7d-65fa-4e17-baf9-bede75047e0a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:05.136410 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-746a5d7d-65fa-4e17-baf9-bede75047e0a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:05.151268 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-746a5d7d-65fa-4e17-baf9-bede75047e0a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] HTTP exception thrown: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-746a5d7d-65fa-4e17-baf9-bede75047e0a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Request method failure captured: Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: DELETE /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 HTTP/1.1 Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtrf71VhcaY_BRgY09rn0Fziy7wn5zvqq7Sl8w3d-pKgYE-iVsAEtAdWeB672MRu6Lj9k4L2KiqNiPpLYnBcyDEyKIewqW3G00eAeBGwM_xApGSar36v-W3E_-BHmWMdmz_Q7eBKs4c3wLUJgtuRau-8AFYp9P52SyX-QwaxLcU8tsE Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 38d1778202d041b58934150c6af9685c Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-TestVolumeBootPattern-24941892 Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 13:00:05.152967 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 13:00:05.154422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38d1778202d041b58934150c6af9685c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d1778202d041b58934150c6af9685c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d1778202d041b58934150c6af9685c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38d1778202d041b58934150c6af9685c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:00:05.154422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-TestVolumeBootPattern-24941892 Oct 03 13:00:05.154422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 38d1778202d041b58934150c6af9685c Oct 03 13:00:05.154422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-TestVolumeBootPattern-24941892 Oct 03 13:00:05.154422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-TestVolumeBootPattern-24941892-project Oct 03 13:00:05.154422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 13:00:05.154422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 13:00:05.154422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 7ffffa27986f461ebc10c23c3c9817f0 Oct 03 13:00:05.154422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-TestVolumeBootPattern-24941892-project Oct 03 13:00:05.154422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 13:00:05.154422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. Oct 03 13:00:05.154422 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': '47633cfc-a1d3-41c4-ab31-71cd28896c05'} Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:00:05.155335 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. Oct 03 13:00:05.157122 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:00:05.159098 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-746a5d7d-65fa-4e17-baf9-bede75047e0a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Returning 404 to user: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:00:05.159098 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-746a5d7d-65fa-4e17-baf9-bede75047e0a tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "DELETE /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 404 len: 111 microversion: 2.1 time: 0.033823 Oct 03 13:00:05.159098 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 502/995] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 13:00:05 2022] DELETE /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 13:00:05.165490 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7b616214-9a1c-4474-b55f-b80638c935e6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:05.166300 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-7b616214-9a1c-4474-b55f-b80638c935e6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] [instance: 47633cfc-a1d3-41c4-ab31-71cd28896c05] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:05.173582 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b616214-9a1c-4474-b55f-b80638c935e6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:05.174075 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b616214-9a1c-4474-b55f-b80638c935e6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:05.174515 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b616214-9a1c-4474-b55f-b80638c935e6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:05.175220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b616214-9a1c-4474-b55f-b80638c935e6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:05.175891 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b616214-9a1c-4474-b55f-b80638c935e6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:05.176319 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7b616214-9a1c-4474-b55f-b80638c935e6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:05.191430 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-7b616214-9a1c-4474-b55f-b80638c935e6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] HTTP exception thrown: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7b616214-9a1c-4474-b55f-b80638c935e6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Request method failure captured: Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 HTTP/1.1 Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtrf71VhcaY_BRgY09rn0Fziy7wn5zvqq7Sl8w3d-pKgYE-iVsAEtAdWeB672MRu6Lj9k4L2KiqNiPpLYnBcyDEyKIewqW3G00eAeBGwM_xApGSar36v-W3E_-BHmWMdmz_Q7eBKs4c3wLUJgtuRau-8AFYp9P52SyX-QwaxLcU8tsE Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 38d1778202d041b58934150c6af9685c Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-TestVolumeBootPattern-24941892 Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 13:00:05.193026 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 13:00:05.194783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38d1778202d041b58934150c6af9685c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d1778202d041b58934150c6af9685c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d1778202d041b58934150c6af9685c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38d1778202d041b58934150c6af9685c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:00:05.194783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-TestVolumeBootPattern-24941892 Oct 03 13:00:05.194783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 38d1778202d041b58934150c6af9685c Oct 03 13:00:05.194783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-TestVolumeBootPattern-24941892 Oct 03 13:00:05.194783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-TestVolumeBootPattern-24941892-project Oct 03 13:00:05.194783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 13:00:05.194783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 13:00:05.194783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 7ffffa27986f461ebc10c23c3c9817f0 Oct 03 13:00:05.194783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-TestVolumeBootPattern-24941892-project Oct 03 13:00:05.194783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 13:00:05.194783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. Oct 03 13:00:05.194783 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': '47633cfc-a1d3-41c4-ab31-71cd28896c05'} Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:00:05.195777 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. Oct 03 13:00:05.197238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:00:05.198744 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7b616214-9a1c-4474-b55f-b80638c935e6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Returning 404 to user: Instance 47633cfc-a1d3-41c4-ab31-71cd28896c05 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:00:05.198744 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-7b616214-9a1c-4474-b55f-b80638c935e6 tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05" status: 404 len: 111 microversion: 2.1 time: 0.034230 Oct 03 13:00:05.198744 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 503/996] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:05 2022] GET /compute/v2.1/servers/47633cfc-a1d3-41c4-ab31-71cd28896c05 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:00:05.225317 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-db824ba9-4e92-428d-968a-8a99646661ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:05.251166 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-db824ba9-4e92-428d-968a-8a99646661ca tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 200 len: 1366 microversion: 2.1 time: 0.205060 Oct 03 13:00:05.252629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 494/997] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:05 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:06.275431 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-6e01edad-8a72-49ad-b2dd-d28329b51c1a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:06.276062 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-6e01edad-8a72-49ad-b2dd-d28329b51c1a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:06.283827 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6e01edad-8a72-49ad-b2dd-d28329b51c1a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:06.284318 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6e01edad-8a72-49ad-b2dd-d28329b51c1a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:06.284758 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6e01edad-8a72-49ad-b2dd-d28329b51c1a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:06.285456 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6e01edad-8a72-49ad-b2dd-d28329b51c1a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:06.285916 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6e01edad-8a72-49ad-b2dd-d28329b51c1a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:06.286351 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6e01edad-8a72-49ad-b2dd-d28329b51c1a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:06.419538 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6e01edad-8a72-49ad-b2dd-d28329b51c1a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:06.427353 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-6e01edad-8a72-49ad-b2dd-d28329b51c1a tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 200 len: 1366 microversion: 2.1 time: 0.155704 Oct 03 13:00:06.437368 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 504/998] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:06 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:00:06.441587 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-65ce40a1-9b92-46f8-a72e-955003d347ca req-54665e80-4575-4aac-866d-168392c86756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0a1aa2-1890-4062-bec7-6ab15fe3a595", "name": "network-vif-plugged", "status": "completed", "tag": "68c75d66-fabb-4d68-9545-0cf165338459"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:00:06.451087 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-65ce40a1-9b92-46f8-a72e-955003d347ca req-54665e80-4575-4aac-866d-168392c86756 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:06.451593 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-65ce40a1-9b92-46f8-a72e-955003d347ca req-54665e80-4575-4aac-866d-168392c86756 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:06.452051 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-65ce40a1-9b92-46f8-a72e-955003d347ca req-54665e80-4575-4aac-866d-168392c86756 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:06.463062 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-65ce40a1-9b92-46f8-a72e-955003d347ca req-54665e80-4575-4aac-866d-168392c86756 service nova] Creating event network-vif-plugged:68c75d66-fabb-4d68-9545-0cf165338459 for instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 on hv-cinder-84456 Oct 03 13:00:06.468043 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-65ce40a1-9b92-46f8-a72e-955003d347ca req-54665e80-4575-4aac-866d-168392c86756 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041267 Oct 03 13:00:06.468614 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 495/999] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 13:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:00:06.732465 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-2b9b3a5d-05ef-4ac5-abfb-a68361baa67d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] Calling method '.version_select at 0x7fc7401f28b0>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:06.832446 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:00:06.843714 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-2b9b3a5d-05ef-4ac5-abfb-a68361baa67d tempest-TestVolumeBootPattern-24941892 tempest-TestVolumeBootPattern-24941892-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-745508035" status: 202 len: 0 microversion: 2.1 time: 0.114996 Oct 03 13:00:06.844212 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 505/1000] 10.222.0.33 () {58 vars in 1260 bytes} [Mon Oct 3 13:00:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-745508035 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:00:07.448369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=2 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:00:07.449141 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=10 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:00:07.454023 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-4a227395-cd33-4b11-9cfc-5530403d770e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:07.454737 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-4a227395-cd33-4b11-9cfc-5530403d770e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:07.460928 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4a227395-cd33-4b11-9cfc-5530403d770e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:07.461418 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4a227395-cd33-4b11-9cfc-5530403d770e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:07.462773 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4a227395-cd33-4b11-9cfc-5530403d770e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:07.463610 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4a227395-cd33-4b11-9cfc-5530403d770e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:07.464086 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4a227395-cd33-4b11-9cfc-5530403d770e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:07.464523 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-4a227395-cd33-4b11-9cfc-5530403d770e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:07.685817 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-4a227395-cd33-4b11-9cfc-5530403d770e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:07.694268 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-4a227395-cd33-4b11-9cfc-5530403d770e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 200 len: 1366 microversion: 2.1 time: 0.246854 Oct 03 13:00:07.695036 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 496/1001] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:07 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:00:08.717197 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-6ed20bfb-e8fe-41f8-9d4a-2c863863856b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:08.722835 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-6ed20bfb-e8fe-41f8-9d4a-2c863863856b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:08.731887 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6ed20bfb-e8fe-41f8-9d4a-2c863863856b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:08.733686 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6ed20bfb-e8fe-41f8-9d4a-2c863863856b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:08.733686 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6ed20bfb-e8fe-41f8-9d4a-2c863863856b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:08.734018 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6ed20bfb-e8fe-41f8-9d4a-2c863863856b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:08.734738 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6ed20bfb-e8fe-41f8-9d4a-2c863863856b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:08.735721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6ed20bfb-e8fe-41f8-9d4a-2c863863856b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:08.955443 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6ed20bfb-e8fe-41f8-9d4a-2c863863856b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:08.963773 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-6ed20bfb-e8fe-41f8-9d4a-2c863863856b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 200 len: 1556 microversion: 2.1 time: 0.250852 Oct 03 13:00:08.964678 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 506/1002] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:08 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 1556 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:08.994643 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-378b3613-e73c-4eca-8359-536a9a6186da tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:08.995136 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-378b3613-e73c-4eca-8359-536a9a6186da tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:09.002264 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-378b3613-e73c-4eca-8359-536a9a6186da tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:09.002751 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-378b3613-e73c-4eca-8359-536a9a6186da tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:09.003237 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-378b3613-e73c-4eca-8359-536a9a6186da tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:09.003969 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-378b3613-e73c-4eca-8359-536a9a6186da tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:09.004422 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-378b3613-e73c-4eca-8359-536a9a6186da tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:09.005057 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-378b3613-e73c-4eca-8359-536a9a6186da tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:09.106992 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-378b3613-e73c-4eca-8359-536a9a6186da tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116965 Oct 03 13:00:09.107632 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 497/1003] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Oct 3 13:00:08 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:00:10.398753 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-e428a0ac-bbf0-4c0c-8f62-767bb0122586 req-d6154d5d-30c0-45b3-9c85-91c2bf858a21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c0a1aa2-1890-4062-bec7-6ab15fe3a595", "tag": "68c75d66-fabb-4d68-9545-0cf165338459"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:00:10.416979 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-e428a0ac-bbf0-4c0c-8f62-767bb0122586 req-d6154d5d-30c0-45b3-9c85-91c2bf858a21 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:10.417394 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-e428a0ac-bbf0-4c0c-8f62-767bb0122586 req-d6154d5d-30c0-45b3-9c85-91c2bf858a21 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:10.417831 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-e428a0ac-bbf0-4c0c-8f62-767bb0122586 req-d6154d5d-30c0-45b3-9c85-91c2bf858a21 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:10.429297 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-e428a0ac-bbf0-4c0c-8f62-767bb0122586 req-d6154d5d-30c0-45b3-9c85-91c2bf858a21 service nova] Creating event network-changed:68c75d66-fabb-4d68-9545-0cf165338459 for instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 on hv-cinder-84456 Oct 03 13:00:10.434958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-e428a0ac-bbf0-4c0c-8f62-767bb0122586 req-d6154d5d-30c0-45b3-9c85-91c2bf858a21 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040128 Oct 03 13:00:10.436482 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 507/1004] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 13:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:00:21.216306 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:00:21.217051 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=35 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:00:21.221502 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-dba0625c-41a8-43c8-99fb-1efba3d5de35 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:00:21.223775 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-dba0625c-41a8-43c8-99fb-1efba3d5de35 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:21.229636 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dba0625c-41a8-43c8-99fb-1efba3d5de35 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:21.230121 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dba0625c-41a8-43c8-99fb-1efba3d5de35 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:21.230558 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dba0625c-41a8-43c8-99fb-1efba3d5de35 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:21.231251 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dba0625c-41a8-43c8-99fb-1efba3d5de35 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:21.231732 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dba0625c-41a8-43c8-99fb-1efba3d5de35 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:21.232276 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-dba0625c-41a8-43c8-99fb-1efba3d5de35 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:21.457515 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-dba0625c-41a8-43c8-99fb-1efba3d5de35 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "POST /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3/action" status: 202 len: 0 microversion: 2.1 time: 0.242454 Oct 03 13:00:21.458099 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 498/1005] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 13:00:21 2022] POST /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:00:21.464020 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:00:21.464792 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=18 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:00:21.470581 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-18601304-4d8e-404e-8733-ca342a6c206f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:21.471285 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-18601304-4d8e-404e-8733-ca342a6c206f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:21.477500 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-18601304-4d8e-404e-8733-ca342a6c206f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:21.477989 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-18601304-4d8e-404e-8733-ca342a6c206f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:21.478428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-18601304-4d8e-404e-8733-ca342a6c206f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:21.479124 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-18601304-4d8e-404e-8733-ca342a6c206f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:21.479599 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-18601304-4d8e-404e-8733-ca342a6c206f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:21.480022 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-18601304-4d8e-404e-8733-ca342a6c206f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:21.630066 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-18601304-4d8e-404e-8733-ca342a6c206f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:21.638548 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-18601304-4d8e-404e-8733-ca342a6c206f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1753 microversion: 2.1 time: 0.176107 Oct 03 13:00:21.639225 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 508/1006] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:21 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:22.664350 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0413eec4-57f3-472e-a412-e88bc15fe14f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:22.665075 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-0413eec4-57f3-472e-a412-e88bc15fe14f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:22.672216 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0413eec4-57f3-472e-a412-e88bc15fe14f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:22.672704 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0413eec4-57f3-472e-a412-e88bc15fe14f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:22.673146 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0413eec4-57f3-472e-a412-e88bc15fe14f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:22.673838 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0413eec4-57f3-472e-a412-e88bc15fe14f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:22.674284 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0413eec4-57f3-472e-a412-e88bc15fe14f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:22.674706 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0413eec4-57f3-472e-a412-e88bc15fe14f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:22.818818 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0413eec4-57f3-472e-a412-e88bc15fe14f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:22.827554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0413eec4-57f3-472e-a412-e88bc15fe14f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1758 microversion: 2.1 time: 0.168045 Oct 03 13:00:22.831274 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 499/1007] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:22 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:23.860813 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-40711853-c68f-44b6-8fa8-2477087e9a22 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:23.861436 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-40711853-c68f-44b6-8fa8-2477087e9a22 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:23.868552 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40711853-c68f-44b6-8fa8-2477087e9a22 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:23.869040 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40711853-c68f-44b6-8fa8-2477087e9a22 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:23.869481 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40711853-c68f-44b6-8fa8-2477087e9a22 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:23.870178 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40711853-c68f-44b6-8fa8-2477087e9a22 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:23.870633 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40711853-c68f-44b6-8fa8-2477087e9a22 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:23.871062 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40711853-c68f-44b6-8fa8-2477087e9a22 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:24.015547 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-40711853-c68f-44b6-8fa8-2477087e9a22 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:24.023755 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-40711853-c68f-44b6-8fa8-2477087e9a22 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1758 microversion: 2.1 time: 0.167437 Oct 03 13:00:24.024367 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 509/1008] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:23 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:25.048385 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-47016197-309a-458a-ad56-a0db7d4138a8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:25.049016 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-47016197-309a-458a-ad56-a0db7d4138a8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:25.055496 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-47016197-309a-458a-ad56-a0db7d4138a8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:25.055978 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-47016197-309a-458a-ad56-a0db7d4138a8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:25.056418 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-47016197-309a-458a-ad56-a0db7d4138a8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:25.057102 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-47016197-309a-458a-ad56-a0db7d4138a8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:25.057554 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-47016197-309a-458a-ad56-a0db7d4138a8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:25.057975 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-47016197-309a-458a-ad56-a0db7d4138a8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:25.199714 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-47016197-309a-458a-ad56-a0db7d4138a8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:25.208678 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-47016197-309a-458a-ad56-a0db7d4138a8 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1758 microversion: 2.1 time: 0.164623 Oct 03 13:00:25.222743 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 500/1009] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:25 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:26.231716 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f689bf33-9006-4d2e-83d2-3d8cadfc1baf tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:26.232350 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f689bf33-9006-4d2e-83d2-3d8cadfc1baf tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:26.239092 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f689bf33-9006-4d2e-83d2-3d8cadfc1baf tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:26.243902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f689bf33-9006-4d2e-83d2-3d8cadfc1baf tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:26.243902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f689bf33-9006-4d2e-83d2-3d8cadfc1baf tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:26.243902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f689bf33-9006-4d2e-83d2-3d8cadfc1baf tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:26.243902 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f689bf33-9006-4d2e-83d2-3d8cadfc1baf tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:26.244275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f689bf33-9006-4d2e-83d2-3d8cadfc1baf tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:26.392798 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-f689bf33-9006-4d2e-83d2-3d8cadfc1baf tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:26.401084 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f689bf33-9006-4d2e-83d2-3d8cadfc1baf tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1758 microversion: 2.1 time: 0.173373 Oct 03 13:00:26.401652 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 510/1010] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:26 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:27.425110 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-56686f0c-b259-44e3-b9c6-b1e398953e17 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:27.425903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-56686f0c-b259-44e3-b9c6-b1e398953e17 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:27.432298 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-56686f0c-b259-44e3-b9c6-b1e398953e17 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:27.432785 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-56686f0c-b259-44e3-b9c6-b1e398953e17 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:27.433222 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-56686f0c-b259-44e3-b9c6-b1e398953e17 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:27.433915 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-56686f0c-b259-44e3-b9c6-b1e398953e17 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:27.434370 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-56686f0c-b259-44e3-b9c6-b1e398953e17 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:27.434796 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-56686f0c-b259-44e3-b9c6-b1e398953e17 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:27.580710 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-56686f0c-b259-44e3-b9c6-b1e398953e17 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:27.588907 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-56686f0c-b259-44e3-b9c6-b1e398953e17 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1758 microversion: 2.1 time: 0.168153 Oct 03 13:00:27.589465 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 501/1011] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:27 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:28.612142 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-6fda06f4-991a-4a40-a95c-59f130bdd82e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:28.612719 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-6fda06f4-991a-4a40-a95c-59f130bdd82e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:28.619054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6fda06f4-991a-4a40-a95c-59f130bdd82e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:28.619583 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6fda06f4-991a-4a40-a95c-59f130bdd82e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:28.620027 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6fda06f4-991a-4a40-a95c-59f130bdd82e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:28.620721 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6fda06f4-991a-4a40-a95c-59f130bdd82e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:28.621186 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6fda06f4-991a-4a40-a95c-59f130bdd82e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:28.621608 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6fda06f4-991a-4a40-a95c-59f130bdd82e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:28.765017 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6fda06f4-991a-4a40-a95c-59f130bdd82e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:28.774033 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-6fda06f4-991a-4a40-a95c-59f130bdd82e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1758 microversion: 2.1 time: 0.166127 Oct 03 13:00:28.774601 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 511/1012] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:28 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:29.797657 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-47f50f42-36d6-44fb-9359-98031d122535 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:29.798336 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-47f50f42-36d6-44fb-9359-98031d122535 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:29.804844 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-47f50f42-36d6-44fb-9359-98031d122535 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:29.805327 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-47f50f42-36d6-44fb-9359-98031d122535 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:29.805761 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-47f50f42-36d6-44fb-9359-98031d122535 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:29.806446 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-47f50f42-36d6-44fb-9359-98031d122535 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:29.806901 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-47f50f42-36d6-44fb-9359-98031d122535 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:29.807371 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-47f50f42-36d6-44fb-9359-98031d122535 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:29.949532 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-47f50f42-36d6-44fb-9359-98031d122535 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:29.958226 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-47f50f42-36d6-44fb-9359-98031d122535 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1758 microversion: 2.1 time: 0.164405 Oct 03 13:00:29.958792 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 502/1013] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:29 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:30.985338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-40471740-430b-4a0a-a01b-9898d74ed399 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:30.986577 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-40471740-430b-4a0a-a01b-9898d74ed399 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:30.992845 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40471740-430b-4a0a-a01b-9898d74ed399 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:30.993601 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40471740-430b-4a0a-a01b-9898d74ed399 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:30.994037 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40471740-430b-4a0a-a01b-9898d74ed399 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:30.994729 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40471740-430b-4a0a-a01b-9898d74ed399 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:30.995178 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40471740-430b-4a0a-a01b-9898d74ed399 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:30.995638 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-40471740-430b-4a0a-a01b-9898d74ed399 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:31.137655 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-40471740-430b-4a0a-a01b-9898d74ed399 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:31.146300 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-40471740-430b-4a0a-a01b-9898d74ed399 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1758 microversion: 2.1 time: 0.164846 Oct 03 13:00:31.146862 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 512/1014] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:30 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:32.169724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-958af7c6-9181-4056-a23f-188e5b99808f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:32.170322 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-958af7c6-9181-4056-a23f-188e5b99808f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:32.177699 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-958af7c6-9181-4056-a23f-188e5b99808f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:32.178188 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-958af7c6-9181-4056-a23f-188e5b99808f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:32.178629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-958af7c6-9181-4056-a23f-188e5b99808f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:32.179337 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-958af7c6-9181-4056-a23f-188e5b99808f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:32.179791 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-958af7c6-9181-4056-a23f-188e5b99808f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:32.180220 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-958af7c6-9181-4056-a23f-188e5b99808f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:32.326773 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-958af7c6-9181-4056-a23f-188e5b99808f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:32.335514 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-958af7c6-9181-4056-a23f-188e5b99808f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1758 microversion: 2.1 time: 0.169631 Oct 03 13:00:32.336090 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 503/1015] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:32 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:33.359831 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7d9e3b2c-08f0-44e0-ad5c-ee8df1c6f5b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:33.360498 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-7d9e3b2c-08f0-44e0-ad5c-ee8df1c6f5b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:33.367693 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d9e3b2c-08f0-44e0-ad5c-ee8df1c6f5b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:33.368177 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d9e3b2c-08f0-44e0-ad5c-ee8df1c6f5b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:33.368866 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d9e3b2c-08f0-44e0-ad5c-ee8df1c6f5b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:33.369551 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d9e3b2c-08f0-44e0-ad5c-ee8df1c6f5b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:33.370003 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d9e3b2c-08f0-44e0-ad5c-ee8df1c6f5b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:33.370428 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d9e3b2c-08f0-44e0-ad5c-ee8df1c6f5b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:33.513971 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-7d9e3b2c-08f0-44e0-ad5c-ee8df1c6f5b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:33.522101 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-7d9e3b2c-08f0-44e0-ad5c-ee8df1c6f5b1 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1758 microversion: 2.1 time: 0.166158 Oct 03 13:00:33.522696 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 513/1016] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:33 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:34.545509 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-16ae2b92-f845-487b-a01e-5ae9434f62e7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:34.546067 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-16ae2b92-f845-487b-a01e-5ae9434f62e7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:34.552643 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-16ae2b92-f845-487b-a01e-5ae9434f62e7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:34.553140 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-16ae2b92-f845-487b-a01e-5ae9434f62e7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:34.553576 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-16ae2b92-f845-487b-a01e-5ae9434f62e7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:34.554275 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-16ae2b92-f845-487b-a01e-5ae9434f62e7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:34.554729 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-16ae2b92-f845-487b-a01e-5ae9434f62e7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:34.555155 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-16ae2b92-f845-487b-a01e-5ae9434f62e7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:34.702722 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-16ae2b92-f845-487b-a01e-5ae9434f62e7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:34.711594 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-16ae2b92-f845-487b-a01e-5ae9434f62e7 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1761 microversion: 2.1 time: 0.170061 Oct 03 13:00:34.712168 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 504/1017] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:34 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1761 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:46.427914 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-66691cd5-bced-4604-87dc-7bca56f30dee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:46.428459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-66691cd5-bced-4604-87dc-7bca56f30dee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:46.430821 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=12 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:00:46.431510 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=36 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:00:46.436162 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-66691cd5-bced-4604-87dc-7bca56f30dee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:46.436660 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-66691cd5-bced-4604-87dc-7bca56f30dee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:46.437107 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-66691cd5-bced-4604-87dc-7bca56f30dee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:46.437810 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-66691cd5-bced-4604-87dc-7bca56f30dee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:46.438300 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-66691cd5-bced-4604-87dc-7bca56f30dee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:46.438728 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-66691cd5-bced-4604-87dc-7bca56f30dee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:46.462873 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-66691cd5-bced-4604-87dc-7bca56f30dee tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595/ips" status: 200 len: 149 microversion: 2.1 time: 0.039593 Oct 03 13:00:46.463476 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 514/1018] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 13:00:46 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:00:48.053538 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-5304c0b9-9e69-4092-a5e5-bcb883db645e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d8f04e9-7cb6-45af-9f1d-d6320afffd66"}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:00:48.057346 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-5304c0b9-9e69-4092-a5e5-bcb883db645e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:48.060385 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=14 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:00:48.061063 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:00:48.065758 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5304c0b9-9e69-4092-a5e5-bcb883db645e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:48.066506 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5304c0b9-9e69-4092-a5e5-bcb883db645e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:48.067286 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5304c0b9-9e69-4092-a5e5-bcb883db645e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:48.068257 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5304c0b9-9e69-4092-a5e5-bcb883db645e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:48.069018 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5304c0b9-9e69-4092-a5e5-bcb883db645e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:48.069455 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-5304c0b9-9e69-4092-a5e5-bcb883db645e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:48.908654 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-5304c0b9-9e69-4092-a5e5-bcb883db645e tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "POST /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.860333 Oct 03 13:00:48.909265 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 505/1019] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 13:00:48 2022] POST /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595/os-volume_attachments => generated 194 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:00:56.555261 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3cae4e84-7495-4782-bd3a-070ee3d465c9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:56.555797 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3cae4e84-7495-4782-bd3a-070ee3d465c9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:56.562947 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3cae4e84-7495-4782-bd3a-070ee3d465c9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:56.563471 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3cae4e84-7495-4782-bd3a-070ee3d465c9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:56.563916 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3cae4e84-7495-4782-bd3a-070ee3d465c9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:56.564610 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3cae4e84-7495-4782-bd3a-070ee3d465c9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:56.565071 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3cae4e84-7495-4782-bd3a-070ee3d465c9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:56.565501 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3cae4e84-7495-4782-bd3a-070ee3d465c9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:56.645358 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-3cae4e84-7495-4782-bd3a-070ee3d465c9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lazy-loading 'services' on Instance uuid 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:00:56.844516 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3cae4e84-7495-4782-bd3a-070ee3d465c9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595/os-volume_attachments/3d8f04e9-7cb6-45af-9f1d-d6320afffd66" status: 202 len: 0 microversion: 2.1 time: 0.293330 Oct 03 13:00:56.845209 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 515/1020] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 13:00:56 2022] DELETE /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595/os-volume_attachments/3d8f04e9-7cb6-45af-9f1d-d6320afffd66 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:00:56.854270 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2ee2b9c1-1d7f-41d6-bff4-d737b6b22c46 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:56.856601 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2ee2b9c1-1d7f-41d6-bff4-d737b6b22c46 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:56.863003 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2ee2b9c1-1d7f-41d6-bff4-d737b6b22c46 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:56.864158 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2ee2b9c1-1d7f-41d6-bff4-d737b6b22c46 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:56.864158 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2ee2b9c1-1d7f-41d6-bff4-d737b6b22c46 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:56.864976 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2ee2b9c1-1d7f-41d6-bff4-d737b6b22c46 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:56.865433 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2ee2b9c1-1d7f-41d6-bff4-d737b6b22c46 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:56.866611 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2ee2b9c1-1d7f-41d6-bff4-d737b6b22c46 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:56.897566 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-2ee2b9c1-1d7f-41d6-bff4-d737b6b22c46 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047724 Oct 03 13:00:56.898126 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 506/1021] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 13:00:56 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:00:57.911186 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b78ea9e6-d486-4808-aa45-831b8020b42f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:57.913560 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b78ea9e6-d486-4808-aa45-831b8020b42f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:57.919844 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b78ea9e6-d486-4808-aa45-831b8020b42f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:57.920333 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b78ea9e6-d486-4808-aa45-831b8020b42f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:57.920768 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b78ea9e6-d486-4808-aa45-831b8020b42f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:57.921455 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b78ea9e6-d486-4808-aa45-831b8020b42f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:57.921907 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b78ea9e6-d486-4808-aa45-831b8020b42f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:57.922329 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b78ea9e6-d486-4808-aa45-831b8020b42f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:57.950612 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-b78ea9e6-d486-4808-aa45-831b8020b42f tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045038 Oct 03 13:00:57.951539 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 516/1022] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 13:00:57 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 13:00:58.015271 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d3066429-0a54-4832-a461-3658329eaaa2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:58.015799 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d3066429-0a54-4832-a461-3658329eaaa2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:58.022703 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d3066429-0a54-4832-a461-3658329eaaa2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:58.026620 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d3066429-0a54-4832-a461-3658329eaaa2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:58.026620 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d3066429-0a54-4832-a461-3658329eaaa2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:58.026620 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d3066429-0a54-4832-a461-3658329eaaa2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:58.026620 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d3066429-0a54-4832-a461-3658329eaaa2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:58.027067 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d3066429-0a54-4832-a461-3658329eaaa2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:58.050308 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d3066429-0a54-4832-a461-3658329eaaa2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Going to try to terminate instance {{(pid=127544) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:00:58.350221 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d3066429-0a54-4832-a461-3658329eaaa2 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 204 len: 0 microversion: 2.1 time: 0.338495 Oct 03 13:00:58.354865 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 507/1023] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 13:00:58 2022] DELETE /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:00:58.359077 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-6c16fba2-c135-4095-b5e2-08e9ab7da2eb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:58.359714 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-6c16fba2-c135-4095-b5e2-08e9ab7da2eb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:58.365691 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6c16fba2-c135-4095-b5e2-08e9ab7da2eb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:58.366199 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6c16fba2-c135-4095-b5e2-08e9ab7da2eb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:58.366616 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6c16fba2-c135-4095-b5e2-08e9ab7da2eb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:58.367304 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6c16fba2-c135-4095-b5e2-08e9ab7da2eb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:58.367784 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6c16fba2-c135-4095-b5e2-08e9ab7da2eb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:58.368207 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6c16fba2-c135-4095-b5e2-08e9ab7da2eb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:58.505879 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-6c16fba2-c135-4095-b5e2-08e9ab7da2eb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:58.513726 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-6c16fba2-c135-4095-b5e2-08e9ab7da2eb tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 200 len: 1680 microversion: 2.1 time: 0.158496 Oct 03 13:00:58.514303 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 517/1024] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:58 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:00:59.538558 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0a4f66e9-1332-4ba7-889d-bb8e53357d51 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:00:59.539165 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-0a4f66e9-1332-4ba7-889d-bb8e53357d51 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:00:59.545789 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a4f66e9-1332-4ba7-889d-bb8e53357d51 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:59.546275 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a4f66e9-1332-4ba7-889d-bb8e53357d51 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:59.546738 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a4f66e9-1332-4ba7-889d-bb8e53357d51 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:59.547466 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a4f66e9-1332-4ba7-889d-bb8e53357d51 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:00:59.547927 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a4f66e9-1332-4ba7-889d-bb8e53357d51 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:00:59.548354 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0a4f66e9-1332-4ba7-889d-bb8e53357d51 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:00:59.674549 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0a4f66e9-1332-4ba7-889d-bb8e53357d51 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:00:59.682650 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0a4f66e9-1332-4ba7-889d-bb8e53357d51 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 200 len: 1680 microversion: 2.1 time: 0.148424 Oct 03 13:00:59.683458 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 508/1025] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:00:59 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:01:00.706058 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ef5acb60-18d7-4390-baa5-b29c2c0ff4a6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:00.707263 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-ef5acb60-18d7-4390-baa5-b29c2c0ff4a6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:00.715715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ef5acb60-18d7-4390-baa5-b29c2c0ff4a6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:00.716211 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ef5acb60-18d7-4390-baa5-b29c2c0ff4a6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:00.716649 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ef5acb60-18d7-4390-baa5-b29c2c0ff4a6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:00.717354 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ef5acb60-18d7-4390-baa5-b29c2c0ff4a6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:00.717814 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ef5acb60-18d7-4390-baa5-b29c2c0ff4a6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:00.718244 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ef5acb60-18d7-4390-baa5-b29c2c0ff4a6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:00.782676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-ef5acb60-18d7-4390-baa5-b29c2c0ff4a6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:01:00.791799 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-ef5acb60-18d7-4390-baa5-b29c2c0ff4a6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 200 len: 1613 microversion: 2.1 time: 0.089569 Oct 03 13:01:00.792606 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 518/1026] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:01:00 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:01:00.833699 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-d1681214-2580-468c-8df3-87078f7134c6 req-a16150b7-21ca-4d16-b7f4-f659169de099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0a1aa2-1890-4062-bec7-6ab15fe3a595", "name": "network-vif-deleted", "tag": "68c75d66-fabb-4d68-9545-0cf165338459"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:01:00.843343 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-d1681214-2580-468c-8df3-87078f7134c6 req-a16150b7-21ca-4d16-b7f4-f659169de099 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:00.843841 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-d1681214-2580-468c-8df3-87078f7134c6 req-a16150b7-21ca-4d16-b7f4-f659169de099 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:00.844278 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-d1681214-2580-468c-8df3-87078f7134c6 req-a16150b7-21ca-4d16-b7f4-f659169de099 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:00.856078 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-d1681214-2580-468c-8df3-87078f7134c6 req-a16150b7-21ca-4d16-b7f4-f659169de099 service nova] Creating event network-vif-deleted:68c75d66-fabb-4d68-9545-0cf165338459 for instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 on hv-cinder-84456 Oct 03 13:01:00.861021 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-d1681214-2580-468c-8df3-87078f7134c6 req-a16150b7-21ca-4d16-b7f4-f659169de099 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032446 Oct 03 13:01:00.861731 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 509/1027] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 13:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:01:01.814928 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-2e0ee4c6-2bd5-4081-a8e6-dee3fc6e0f5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:01.815637 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-2e0ee4c6-2bd5-4081-a8e6-dee3fc6e0f5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:01.821884 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2e0ee4c6-2bd5-4081-a8e6-dee3fc6e0f5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:01.825341 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2e0ee4c6-2bd5-4081-a8e6-dee3fc6e0f5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:01.825341 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2e0ee4c6-2bd5-4081-a8e6-dee3fc6e0f5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:01.825341 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2e0ee4c6-2bd5-4081-a8e6-dee3fc6e0f5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:01.825341 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2e0ee4c6-2bd5-4081-a8e6-dee3fc6e0f5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:01.825732 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2e0ee4c6-2bd5-4081-a8e6-dee3fc6e0f5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:01.857027 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2e0ee4c6-2bd5-4081-a8e6-dee3fc6e0f5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:01.857540 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2e0ee4c6-2bd5-4081-a8e6-dee3fc6e0f5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:01.857984 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-2e0ee4c6-2bd5-4081-a8e6-dee3fc6e0f5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:01.858439 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-2e0ee4c6-2bd5-4081-a8e6-dee3fc6e0f5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lazy-loading 'fault' on Instance uuid 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:01:01.903269 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-2e0ee4c6-2bd5-4081-a8e6-dee3fc6e0f5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e29a4c0276247c286cff3eed5a1253a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484522301976426dae50e64c141c727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:01:01.911053 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-2e0ee4c6-2bd5-4081-a8e6-dee3fc6e0f5c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 200 len: 1331 microversion: 2.1 time: 0.099851 Oct 03 13:01:01.911671 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 519/1028] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:01:01 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:01:02.935345 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3d5e22f4-6a3f-4489-9e75-7bf830feeaba tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:02.935968 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-3d5e22f4-6a3f-4489-9e75-7bf830feeaba tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:02.942082 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3d5e22f4-6a3f-4489-9e75-7bf830feeaba tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:02.942558 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3d5e22f4-6a3f-4489-9e75-7bf830feeaba tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:02.942982 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3d5e22f4-6a3f-4489-9e75-7bf830feeaba tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:02.943705 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3d5e22f4-6a3f-4489-9e75-7bf830feeaba tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:02.944156 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3d5e22f4-6a3f-4489-9e75-7bf830feeaba tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:02.944626 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-3d5e22f4-6a3f-4489-9e75-7bf830feeaba tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:02.957970 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-3d5e22f4-6a3f-4489-9e75-7bf830feeaba tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] HTTP exception thrown: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3d5e22f4-6a3f-4489-9e75-7bf830feeaba tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Request method failure captured: Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 HTTP/1.1 Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtv1CNm_b3zyY3l-zqVpZ2PQwqysRe2xnTgm3TNFdQ3cxiuS5j1-KWYI4GxOIqIjyZXbTsRo_o30sxOzEi3tD56qI7VaNvXIBy0ny91RFTfbOk3WiMgFKVlDpWGpK6dHDg9Zbd0fRbIxhEH2S7Uy_tqxJtEm9mgtQiU5SFB6-mN0xzA Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 13:01:02.959677 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 13:01:02.961245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_484522301976426dae50e64c141c727e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/484522301976426dae50e64c141c727e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:01:02.961245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:02.961245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:02.961245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:02.961245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:02.961245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 13:01:02.961245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 13:01:02.961245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: 5e29a4c0276247c286cff3eed5a1253a Oct 03 13:01:02.961245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:02.961245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 13:01:02.961245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. Oct 03 13:01:02.961245 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': '0c0a1aa2-1890-4062-bec7-6ab15fe3a595'} Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:01:02.963072 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. Oct 03 13:01:02.964693 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:02.965906 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-3d5e22f4-6a3f-4489-9e75-7bf830feeaba tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Returning 404 to user: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:01:02.965906 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-3d5e22f4-6a3f-4489-9e75-7bf830feeaba tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 404 len: 111 microversion: 2.1 time: 0.030544 Oct 03 13:01:02.965906 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 510/1029] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:01:02 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:01:02.969836 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-53433731-987e-49e2-b39a-9faee7968e6c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '.version_select at 0x7fc7400b1670>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:03.046856 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-53433731-987e-49e2-b39a-9faee7968e6c tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-459579982" status: 202 len: 0 microversion: 2.1 time: 0.080796 Oct 03 13:01:03.047472 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 520/1030] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Oct 3 13:01:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-459579982 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:01:05.060781 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2d787bf5-6850-4f6f-ae9f-1bd4a7e753d6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:05.061278 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-2d787bf5-6850-4f6f-ae9f-1bd4a7e753d6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:05.068529 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2d787bf5-6850-4f6f-ae9f-1bd4a7e753d6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:05.069003 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2d787bf5-6850-4f6f-ae9f-1bd4a7e753d6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:05.069435 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2d787bf5-6850-4f6f-ae9f-1bd4a7e753d6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:05.070121 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2d787bf5-6850-4f6f-ae9f-1bd4a7e753d6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:05.070569 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2d787bf5-6850-4f6f-ae9f-1bd4a7e753d6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:05.070988 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-2d787bf5-6850-4f6f-ae9f-1bd4a7e753d6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:05.084579 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-2d787bf5-6850-4f6f-ae9f-1bd4a7e753d6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] HTTP exception thrown: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2d787bf5-6850-4f6f-ae9f-1bd4a7e753d6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Request method failure captured: Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: DELETE /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 HTTP/1.1 Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtv1CNm_b3zyY3l-zqVpZ2PQwqysRe2xnTgm3TNFdQ3cxiuS5j1-KWYI4GxOIqIjyZXbTsRo_o30sxOzEi3tD56qI7VaNvXIBy0ny91RFTfbOk3WiMgFKVlDpWGpK6dHDg9Zbd0fRbIxhEH2S7Uy_tqxJtEm9mgtQiU5SFB6-mN0xzA Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 13:01:05.086103 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 13:01:05.087802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_484522301976426dae50e64c141c727e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/484522301976426dae50e64c141c727e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:01:05.087802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:05.087802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:05.087802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:05.087802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:05.087802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 13:01:05.087802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 13:01:05.087802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: 5e29a4c0276247c286cff3eed5a1253a Oct 03 13:01:05.087802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:05.087802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 13:01:05.087802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. Oct 03 13:01:05.087802 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': '0c0a1aa2-1890-4062-bec7-6ab15fe3a595'} Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:01:05.088746 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. Oct 03 13:01:05.090297 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:05.091910 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-2d787bf5-6850-4f6f-ae9f-1bd4a7e753d6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Returning 404 to user: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:01:05.091910 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-2d787bf5-6850-4f6f-ae9f-1bd4a7e753d6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 404 len: 111 microversion: 2.1 time: 0.030541 Oct 03 13:01:05.091910 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 511/1031] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 13:01:05 2022] DELETE /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:01:05.096483 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-014f4721-08a7-44df-afde-6e7a3f1f1788 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:05.097131 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-014f4721-08a7-44df-afde-6e7a3f1f1788 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 0c0a1aa2-1890-4062-bec7-6ab15fe3a595] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:05.103623 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-014f4721-08a7-44df-afde-6e7a3f1f1788 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:05.104113 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-014f4721-08a7-44df-afde-6e7a3f1f1788 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:05.104554 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-014f4721-08a7-44df-afde-6e7a3f1f1788 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:05.105244 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-014f4721-08a7-44df-afde-6e7a3f1f1788 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:05.105702 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-014f4721-08a7-44df-afde-6e7a3f1f1788 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:05.106131 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-014f4721-08a7-44df-afde-6e7a3f1f1788 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:05.119093 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-014f4721-08a7-44df-afde-6e7a3f1f1788 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] HTTP exception thrown: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-014f4721-08a7-44df-afde-6e7a3f1f1788 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Request method failure captured: Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 HTTP/1.1 Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtv1CNm_b3zyY3l-zqVpZ2PQwqysRe2xnTgm3TNFdQ3cxiuS5j1-KWYI4GxOIqIjyZXbTsRo_o30sxOzEi3tD56qI7VaNvXIBy0ny91RFTfbOk3WiMgFKVlDpWGpK6dHDg9Zbd0fRbIxhEH2S7Uy_tqxJtEm9mgtQiU5SFB6-mN0xzA Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 13:01:05.120748 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 13:01:05.122320 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_484522301976426dae50e64c141c727e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/484522301976426dae50e64c141c727e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:01:05.122320 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:05.122320 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:05.122320 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:05.122320 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:05.122320 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 13:01:05.122320 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 13:01:05.122320 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 5e29a4c0276247c286cff3eed5a1253a Oct 03 13:01:05.122320 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:05.122320 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 13:01:05.122320 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. Oct 03 13:01:05.122320 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': '0c0a1aa2-1890-4062-bec7-6ab15fe3a595'} Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:01:05.123561 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. Oct 03 13:01:05.125163 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:05.126478 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-014f4721-08a7-44df-afde-6e7a3f1f1788 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Returning 404 to user: Instance 0c0a1aa2-1890-4062-bec7-6ab15fe3a595 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:01:05.126478 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-014f4721-08a7-44df-afde-6e7a3f1f1788 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595" status: 404 len: 111 microversion: 2.1 time: 0.030148 Oct 03 13:01:05.126478 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 521/1032] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:01:05 2022] GET /compute/v2.1/servers/0c0a1aa2-1890-4062-bec7-6ab15fe3a595 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 13:01:06.518221 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a7c67fbc-5105-4337-b849-b5b5279bcfd6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:06.519270 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a7c67fbc-5105-4337-b849-b5b5279bcfd6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:06.525744 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a7c67fbc-5105-4337-b849-b5b5279bcfd6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:06.526229 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a7c67fbc-5105-4337-b849-b5b5279bcfd6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:06.526668 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a7c67fbc-5105-4337-b849-b5b5279bcfd6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:06.527387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a7c67fbc-5105-4337-b849-b5b5279bcfd6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:06.527844 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a7c67fbc-5105-4337-b849-b5b5279bcfd6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:06.528272 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a7c67fbc-5105-4337-b849-b5b5279bcfd6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:06.541982 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-a7c67fbc-5105-4337-b849-b5b5279bcfd6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] HTTP exception thrown: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a7c67fbc-5105-4337-b849-b5b5279bcfd6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Request method failure captured: Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: DELETE /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da HTTP/1.1 Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtv1CNm_b3zyY3l-zqVpZ2PQwqysRe2xnTgm3TNFdQ3cxiuS5j1-KWYI4GxOIqIjyZXbTsRo_o30sxOzEi3tD56qI7VaNvXIBy0ny91RFTfbOk3WiMgFKVlDpWGpK6dHDg9Zbd0fRbIxhEH2S7Uy_tqxJtEm9mgtQiU5SFB6-mN0xzA Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 13:01:06.543534 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 13:01:06.545206 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_484522301976426dae50e64c141c727e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/484522301976426dae50e64c141c727e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:01:06.545206 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:06.545206 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:06.545206 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:06.545206 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:06.545206 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 13:01:06.545206 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 13:01:06.545206 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: 5e29a4c0276247c286cff3eed5a1253a Oct 03 13:01:06.545206 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:06.545206 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 13:01:06.545206 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. Oct 03 13:01:06.545206 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': '77b582d3-a18f-4bed-adf0-5f8107ef89da'} Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:01:06.546160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. Oct 03 13:01:06.547812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.549414 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a7c67fbc-5105-4337-b849-b5b5279bcfd6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Returning 404 to user: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:01:06.549414 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a7c67fbc-5105-4337-b849-b5b5279bcfd6 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "DELETE /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 404 len: 111 microversion: 2.1 time: 0.030526 Oct 03 13:01:06.549414 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 512/1033] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 13:01:06 2022] DELETE /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:01:06.553268 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1767968a-cd43-4981-8852-2b6c7e58b145 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:06.553891 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-1767968a-cd43-4981-8852-2b6c7e58b145 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 77b582d3-a18f-4bed-adf0-5f8107ef89da] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:06.560196 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1767968a-cd43-4981-8852-2b6c7e58b145 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:06.574756 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1767968a-cd43-4981-8852-2b6c7e58b145 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:06.574756 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1767968a-cd43-4981-8852-2b6c7e58b145 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:06.574756 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1767968a-cd43-4981-8852-2b6c7e58b145 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:06.574756 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1767968a-cd43-4981-8852-2b6c7e58b145 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:06.575148 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-1767968a-cd43-4981-8852-2b6c7e58b145 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:06.576387 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-1767968a-cd43-4981-8852-2b6c7e58b145 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] HTTP exception thrown: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1767968a-cd43-4981-8852-2b6c7e58b145 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Request method failure captured: Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da HTTP/1.1 Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtv1CNm_b3zyY3l-zqVpZ2PQwqysRe2xnTgm3TNFdQ3cxiuS5j1-KWYI4GxOIqIjyZXbTsRo_o30sxOzEi3tD56qI7VaNvXIBy0ny91RFTfbOk3WiMgFKVlDpWGpK6dHDg9Zbd0fRbIxhEH2S7Uy_tqxJtEm9mgtQiU5SFB6-mN0xzA Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 13:01:06.577922 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 13:01:06.579509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_484522301976426dae50e64c141c727e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/484522301976426dae50e64c141c727e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:01:06.579509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:06.579509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:06.579509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:06.579509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:06.579509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 13:01:06.579509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 13:01:06.579509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 5e29a4c0276247c286cff3eed5a1253a Oct 03 13:01:06.579509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:06.579509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 13:01:06.579509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. Oct 03 13:01:06.579509 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': '77b582d3-a18f-4bed-adf0-5f8107ef89da'} Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:01:06.580425 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. Oct 03 13:01:06.582532 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.583936 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-1767968a-cd43-4981-8852-2b6c7e58b145 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Returning 404 to user: Instance 77b582d3-a18f-4bed-adf0-5f8107ef89da could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:01:06.583936 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-1767968a-cd43-4981-8852-2b6c7e58b145 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da" status: 404 len: 111 microversion: 2.1 time: 0.029826 Oct 03 13:01:06.583936 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 522/1034] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:01:06 2022] GET /compute/v2.1/servers/77b582d3-a18f-4bed-adf0-5f8107ef89da => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:01:06.588436 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e49d5862-85ba-4964-a943-6c6ea1e9502b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:06.588940 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-e49d5862-85ba-4964-a943-6c6ea1e9502b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:06.594830 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e49d5862-85ba-4964-a943-6c6ea1e9502b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:06.595343 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e49d5862-85ba-4964-a943-6c6ea1e9502b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:06.595799 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e49d5862-85ba-4964-a943-6c6ea1e9502b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:06.596489 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e49d5862-85ba-4964-a943-6c6ea1e9502b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:06.597082 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e49d5862-85ba-4964-a943-6c6ea1e9502b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:06.597619 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e49d5862-85ba-4964-a943-6c6ea1e9502b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:06.610785 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-e49d5862-85ba-4964-a943-6c6ea1e9502b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] HTTP exception thrown: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e49d5862-85ba-4964-a943-6c6ea1e9502b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Request method failure captured: Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: DELETE /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 HTTP/1.1 Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtv1CNm_b3zyY3l-zqVpZ2PQwqysRe2xnTgm3TNFdQ3cxiuS5j1-KWYI4GxOIqIjyZXbTsRo_o30sxOzEi3tD56qI7VaNvXIBy0ny91RFTfbOk3WiMgFKVlDpWGpK6dHDg9Zbd0fRbIxhEH2S7Uy_tqxJtEm9mgtQiU5SFB6-mN0xzA Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 13:01:06.612326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 13:01:06.613984 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_484522301976426dae50e64c141c727e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/484522301976426dae50e64c141c727e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:01:06.613984 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:06.613984 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:06.613984 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:06.613984 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:06.613984 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 13:01:06.613984 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 13:01:06.613984 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: 5e29a4c0276247c286cff3eed5a1253a Oct 03 13:01:06.613984 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:06.613984 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 13:01:06.613984 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. Oct 03 13:01:06.613984 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': '74732bd8-7fb6-4f8c-a46b-d58d6c1f4384'} Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:01:06.614962 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. Oct 03 13:01:06.616577 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.618089 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e49d5862-85ba-4964-a943-6c6ea1e9502b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Returning 404 to user: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:01:06.618089 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e49d5862-85ba-4964-a943-6c6ea1e9502b tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "DELETE /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 404 len: 111 microversion: 2.1 time: 0.029106 Oct 03 13:01:06.618089 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 513/1035] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 13:01:06 2022] DELETE /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 13:01:06.622416 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-013c5745-fd2f-4f84-83aa-03b3cb1d97e9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:06.623032 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-013c5745-fd2f-4f84-83aa-03b3cb1d97e9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:06.629550 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-013c5745-fd2f-4f84-83aa-03b3cb1d97e9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:06.630029 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-013c5745-fd2f-4f84-83aa-03b3cb1d97e9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:06.630490 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-013c5745-fd2f-4f84-83aa-03b3cb1d97e9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:06.631181 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-013c5745-fd2f-4f84-83aa-03b3cb1d97e9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:06.631672 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-013c5745-fd2f-4f84-83aa-03b3cb1d97e9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:06.632096 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-013c5745-fd2f-4f84-83aa-03b3cb1d97e9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:06.646112 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-013c5745-fd2f-4f84-83aa-03b3cb1d97e9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] HTTP exception thrown: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-013c5745-fd2f-4f84-83aa-03b3cb1d97e9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Request method failure captured: Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 HTTP/1.1 Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtv1CNm_b3zyY3l-zqVpZ2PQwqysRe2xnTgm3TNFdQ3cxiuS5j1-KWYI4GxOIqIjyZXbTsRo_o30sxOzEi3tD56qI7VaNvXIBy0ny91RFTfbOk3WiMgFKVlDpWGpK6dHDg9Zbd0fRbIxhEH2S7Uy_tqxJtEm9mgtQiU5SFB6-mN0xzA Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 13:01:06.647677 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 13:01:06.649282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_484522301976426dae50e64c141c727e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/484522301976426dae50e64c141c727e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:01:06.649282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:06.649282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:06.649282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:06.649282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:06.649282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 13:01:06.649282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 13:01:06.649282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 5e29a4c0276247c286cff3eed5a1253a Oct 03 13:01:06.649282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:06.649282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 13:01:06.649282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. Oct 03 13:01:06.649282 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': '74732bd8-7fb6-4f8c-a46b-d58d6c1f4384'} Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:01:06.650156 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. Oct 03 13:01:06.651770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:06.653254 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-013c5745-fd2f-4f84-83aa-03b3cb1d97e9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Returning 404 to user: Instance 74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:01:06.653254 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-013c5745-fd2f-4f84-83aa-03b3cb1d97e9 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384" status: 404 len: 111 microversion: 2.1 time: 0.030821 Oct 03 13:01:06.653254 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 523/1036] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:01:06 2022] GET /compute/v2.1/servers/74732bd8-7fb6-4f8c-a46b-d58d6c1f4384 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:01:07.696427 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-653a0322-9df2-4f45-b0d6-86188f0db1e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1179058255"}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:01:07.696973 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-653a0322-9df2-4f45-b0d6-86188f0db1e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:07.703205 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-653a0322-9df2-4f45-b0d6-86188f0db1e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:07.703723 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-653a0322-9df2-4f45-b0d6-86188f0db1e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:07.704160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-653a0322-9df2-4f45-b0d6-86188f0db1e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:07.704848 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-653a0322-9df2-4f45-b0d6-86188f0db1e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:07.705303 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-653a0322-9df2-4f45-b0d6-86188f0db1e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:07.705728 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-653a0322-9df2-4f45-b0d6-86188f0db1e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:07.833507 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.network.security_group_api [None req-653a0322-9df2-4f45-b0d6-86188f0db1e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Removing security group 5151003a-5cd5-408f-adba-43e6814f5c12 from port f317c1e2-f283-4fec-bf28-0094dfcd58ff Oct 03 13:01:07.933893 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7106ec2a-f593-4189-9013-933ff668bd79 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:07.934390 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-7106ec2a-f593-4189-9013-933ff668bd79 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:07.940826 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7106ec2a-f593-4189-9013-933ff668bd79 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:07.941363 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7106ec2a-f593-4189-9013-933ff668bd79 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:07.941747 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7106ec2a-f593-4189-9013-933ff668bd79 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:07.942439 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7106ec2a-f593-4189-9013-933ff668bd79 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:07.942892 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7106ec2a-f593-4189-9013-933ff668bd79 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:07.943327 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7106ec2a-f593-4189-9013-933ff668bd79 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:07.957692 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-7106ec2a-f593-4189-9013-933ff668bd79 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] HTTP exception thrown: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7106ec2a-f593-4189-9013-933ff668bd79 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Request method failure captured: Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: DELETE /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 HTTP/1.1 Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtv1CNm_b3zyY3l-zqVpZ2PQwqysRe2xnTgm3TNFdQ3cxiuS5j1-KWYI4GxOIqIjyZXbTsRo_o30sxOzEi3tD56qI7VaNvXIBy0ny91RFTfbOk3WiMgFKVlDpWGpK6dHDg9Zbd0fRbIxhEH2S7Uy_tqxJtEm9mgtQiU5SFB6-mN0xzA Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 13:01:07.959287 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 13:01:07.961023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_484522301976426dae50e64c141c727e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/484522301976426dae50e64c141c727e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:01:07.961023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:07.961023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:07.961023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:07.961023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:07.961023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 13:01:07.961023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 13:01:07.961023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 5e29a4c0276247c286cff3eed5a1253a Oct 03 13:01:07.961023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:07.961023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 13:01:07.961023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. Oct 03 13:01:07.961023 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': 'a7601de3-6bca-4b56-900b-e5bce92c1286'} Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:01:07.964781 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. Oct 03 13:01:07.966277 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:07.968552 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7106ec2a-f593-4189-9013-933ff668bd79 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Returning 404 to user: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:01:07.968552 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-7106ec2a-f593-4189-9013-933ff668bd79 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 404 len: 111 microversion: 2.1 time: 0.030625 Oct 03 13:01:07.968552 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 524/1037] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 13:01:07 2022] DELETE /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 13:01:07.969155 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f9dafffa-95db-4b9c-8832-93e099364b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:07.969770 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f9dafffa-95db-4b9c-8832-93e099364b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] [instance: a7601de3-6bca-4b56-900b-e5bce92c1286] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:07.976309 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f9dafffa-95db-4b9c-8832-93e099364b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:07.976803 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f9dafffa-95db-4b9c-8832-93e099364b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:07.977243 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f9dafffa-95db-4b9c-8832-93e099364b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:07.977948 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f9dafffa-95db-4b9c-8832-93e099364b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:07.978400 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f9dafffa-95db-4b9c-8832-93e099364b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:07.978823 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f9dafffa-95db-4b9c-8832-93e099364b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:07.992824 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-f9dafffa-95db-4b9c-8832-93e099364b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] HTTP exception thrown: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f9dafffa-95db-4b9c-8832-93e099364b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Request method failure captured: Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 HTTP/1.1 Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtv1CNm_b3zyY3l-zqVpZ2PQwqysRe2xnTgm3TNFdQ3cxiuS5j1-KWYI4GxOIqIjyZXbTsRo_o30sxOzEi3tD56qI7VaNvXIBy0ny91RFTfbOk3WiMgFKVlDpWGpK6dHDg9Zbd0fRbIxhEH2S7Uy_tqxJtEm9mgtQiU5SFB6-mN0xzA Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 13:01:07.994640 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 13:01:08.000931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_484522301976426dae50e64c141c727e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/484522301976426dae50e64c141c727e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/484522301976426dae50e64c141c727e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:01:08.000931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:08.000931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 484522301976426dae50e64c141c727e Oct 03 13:01:08.000931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-37738108 Oct 03 13:01:08.000931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:08.000931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 13:01:08.000931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 13:01:08.000931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 5e29a4c0276247c286cff3eed5a1253a Oct 03 13:01:08.000931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-AttachVolumeNegativeTest-37738108-project Oct 03 13:01:08.000931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 13:01:08.000931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. Oct 03 13:01:08.000931 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': 'a7601de3-6bca-4b56-900b-e5bce92c1286'} Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:01:08.002337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. Oct 03 13:01:08.003983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:08.005338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f9dafffa-95db-4b9c-8832-93e099364b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] Returning 404 to user: Instance a7601de3-6bca-4b56-900b-e5bce92c1286 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:01:08.005338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f9dafffa-95db-4b9c-8832-93e099364b55 tempest-AttachVolumeNegativeTest-37738108 tempest-AttachVolumeNegativeTest-37738108-project] 10.222.0.33 "GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286" status: 404 len: 111 microversion: 2.1 time: 0.030696 Oct 03 13:01:08.005338 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 525/1038] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:01:07 2022] GET /compute/v2.1/servers/a7601de3-6bca-4b56-900b-e5bce92c1286 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:01:08.207122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-653a0322-9df2-4f45-b0d6-86188f0db1e5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "POST /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3/action" status: 202 len: 0 microversion: 2.1 time: 0.514601 Oct 03 13:01:08.221519 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 514/1039] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 13:01:07 2022] POST /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:01:08.415014 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-3bd249f6-c2ed-44b0-a29b-afb952928e8b req-352db55c-9b28-4b08-add4-3db20336ebd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "229aaf8a-e3ce-4319-94b4-7e22662880b3", "tag": "f317c1e2-f283-4fec-bf28-0094dfcd58ff"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:01:08.444918 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-3bd249f6-c2ed-44b0-a29b-afb952928e8b req-352db55c-9b28-4b08-add4-3db20336ebd8 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:08.445412 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-3bd249f6-c2ed-44b0-a29b-afb952928e8b req-352db55c-9b28-4b08-add4-3db20336ebd8 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:08.445859 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-3bd249f6-c2ed-44b0-a29b-afb952928e8b req-352db55c-9b28-4b08-add4-3db20336ebd8 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:08.459083 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-3bd249f6-c2ed-44b0-a29b-afb952928e8b req-352db55c-9b28-4b08-add4-3db20336ebd8 service nova] Creating event network-changed:f317c1e2-f283-4fec-bf28-0094dfcd58ff for instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 on hv-cinder-84456 Oct 03 13:01:08.464970 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-3bd249f6-c2ed-44b0-a29b-afb952928e8b req-352db55c-9b28-4b08-add4-3db20336ebd8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250581 Oct 03 13:01:08.465719 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 526/1040] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 13:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:01:10.638592 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-83294758-4bed-420e-85c2-95d3dba33545 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:10.639163 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-83294758-4bed-420e-85c2-95d3dba33545 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:10.644758 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-4dd9db2f-e71c-4e05-92d9-18b168e0e0bf req-ddf8a8d0-f25a-4fc6-a2f6-1b48ac15919a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "229aaf8a-e3ce-4319-94b4-7e22662880b3", "tag": "f317c1e2-f283-4fec-bf28-0094dfcd58ff"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:01:10.645889 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-83294758-4bed-420e-85c2-95d3dba33545 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:10.646377 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-83294758-4bed-420e-85c2-95d3dba33545 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:10.647003 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-83294758-4bed-420e-85c2-95d3dba33545 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:10.647945 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-83294758-4bed-420e-85c2-95d3dba33545 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:10.648399 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-83294758-4bed-420e-85c2-95d3dba33545 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:10.648822 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-83294758-4bed-420e-85c2-95d3dba33545 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:10.654514 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-4dd9db2f-e71c-4e05-92d9-18b168e0e0bf req-ddf8a8d0-f25a-4fc6-a2f6-1b48ac15919a service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:10.655183 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-4dd9db2f-e71c-4e05-92d9-18b168e0e0bf req-ddf8a8d0-f25a-4fc6-a2f6-1b48ac15919a service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:10.655645 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-4dd9db2f-e71c-4e05-92d9-18b168e0e0bf req-ddf8a8d0-f25a-4fc6-a2f6-1b48ac15919a service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:10.667038 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-4dd9db2f-e71c-4e05-92d9-18b168e0e0bf req-ddf8a8d0-f25a-4fc6-a2f6-1b48ac15919a service nova] Creating event network-changed:f317c1e2-f283-4fec-bf28-0094dfcd58ff for instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 on hv-cinder-84456 Oct 03 13:01:10.671857 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-4dd9db2f-e71c-4e05-92d9-18b168e0e0bf req-ddf8a8d0-f25a-4fc6-a2f6-1b48ac15919a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032146 Oct 03 13:01:10.673570 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 527/1041] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 13:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:01:10.740937 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.objects.instance [None req-83294758-4bed-420e-85c2-95d3dba33545 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lazy-loading 'services' on Instance uuid 229aaf8a-e3ce-4319-94b4-7e22662880b3 {{(pid=127544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:01:11.093287 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-83294758-4bed-420e-85c2-95d3dba33545 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "DELETE /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3/os-volume_attachments/a333f01f-4a0f-4e2b-a5b5-b954557f7a17" status: 202 len: 0 microversion: 2.1 time: 0.459158 Oct 03 13:01:11.094304 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 515/1042] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 13:01:10 2022] DELETE /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3/os-volume_attachments/a333f01f-4a0f-4e2b-a5b5-b954557f7a17 => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:01:11.112374 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-6806bf8e-6421-420b-8b61-83abe350f236 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:11.115585 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-6806bf8e-6421-420b-8b61-83abe350f236 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:11.134329 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6806bf8e-6421-420b-8b61-83abe350f236 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:11.136932 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6806bf8e-6421-420b-8b61-83abe350f236 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:11.136932 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6806bf8e-6421-420b-8b61-83abe350f236 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:11.136932 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6806bf8e-6421-420b-8b61-83abe350f236 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:11.136932 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6806bf8e-6421-420b-8b61-83abe350f236 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:11.137511 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-6806bf8e-6421-420b-8b61-83abe350f236 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:11.206859 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-6806bf8e-6421-420b-8b61-83abe350f236 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100518 Oct 03 13:01:11.213143 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 528/1043] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 13:01:11 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:01:12.223419 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-f4e83a56-75b1-4c0e-bcd2-d981e478ae3f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:12.226565 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-f4e83a56-75b1-4c0e-bcd2-d981e478ae3f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:12.233522 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f4e83a56-75b1-4c0e-bcd2-d981e478ae3f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:12.234256 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f4e83a56-75b1-4c0e-bcd2-d981e478ae3f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:12.234698 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f4e83a56-75b1-4c0e-bcd2-d981e478ae3f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:12.235464 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f4e83a56-75b1-4c0e-bcd2-d981e478ae3f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:12.235923 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f4e83a56-75b1-4c0e-bcd2-d981e478ae3f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:12.236378 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f4e83a56-75b1-4c0e-bcd2-d981e478ae3f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:12.268006 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-f4e83a56-75b1-4c0e-bcd2-d981e478ae3f tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050424 Oct 03 13:01:12.269306 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 516/1044] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 13:01:12 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 13:01:12.279810 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-fce698b3-674f-434f-9987-d4b587469f37 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:12.282615 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-fce698b3-674f-434f-9987-d4b587469f37 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:12.287246 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fce698b3-674f-434f-9987-d4b587469f37 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:12.287980 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fce698b3-674f-434f-9987-d4b587469f37 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:12.288483 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fce698b3-674f-434f-9987-d4b587469f37 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:12.289152 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fce698b3-674f-434f-9987-d4b587469f37 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:12.289776 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fce698b3-674f-434f-9987-d4b587469f37 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:12.290365 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fce698b3-674f-434f-9987-d4b587469f37 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:12.374391 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-fce698b3-674f-434f-9987-d4b587469f37 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] HTTP exception thrown: Instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 is not attached to volume a333f01f-4a0f-4e2b-a5b5-b954557f7a17 Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-fce698b3-674f-434f-9987-d4b587469f37 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Request method failure captured: Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: DELETE /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3/os-volume_attachments/a333f01f-4a0f-4e2b-a5b5-b954557f7a17 HTTP/1.1 Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOtyXoyZgXyPcw-g5PGjf6VzhQAhWxu2EzFDNyH9YO3cGW7H1Xtw9NXugoIMBMkUlU8YB5RGTbH9vh_aUPayDASoxlFzuTywlMtvr5fypLyk157-LmitmDhlex1hqxnngcCPf3xHUq8E_DKknIUeyPIAaHFmkJMGjotYR4aTOsDmOYhM Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: a0a4271779a04986bbd34e2e989f3603 Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-TestMinimumBasicScenario-2034714005 Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 13:01:12.380052 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 13:01:12.381703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a0a4271779a04986bbd34e2e989f3603"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a0a4271779a04986bbd34e2e989f3603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a0a4271779a04986bbd34e2e989f3603"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a0a4271779a04986bbd34e2e989f3603"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:01:12.381703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-TestMinimumBasicScenario-2034714005 Oct 03 13:01:12.381703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: a0a4271779a04986bbd34e2e989f3603 Oct 03 13:01:12.381703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2034714005 Oct 03 13:01:12.381703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-TestMinimumBasicScenario-2034714005-project Oct 03 13:01:12.381703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 13:01:12.381703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 13:01:12.381703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 9a4a9a635aaf44c7b81224a6b0ad9dec Oct 03 13:01:12.381703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-TestMinimumBasicScenario-2034714005-project Oct 03 13:01:12.381703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 13:01:12.381703 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 is not attached to volume a333f01f-4a0f-4e2b-a5b5-b954557f7a17 Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'server_id': '229aaf8a-e3ce-4319-94b4-7e22662880b3', 'id': 'a333f01f-4a0f-4e2b-a5b5-b954557f7a17'} Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a333f01f-4a0f-4e2b-a5b5-b954557f7a17. Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:01:12.382666 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:01:12.389627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:01:12.389627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 03 13:01:12.389627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 13:01:12.389627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 is not attached to volume a333f01f-4a0f-4e2b-a5b5-b954557f7a17 Oct 03 13:01:12.389627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:12.389627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:12.389627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:12.389627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:12.389627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:12.389627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:12.389627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:01:12.389627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:01:12.389627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 is not attached to volume a333f01f-4a0f-4e2b-a5b5-b954557f7a17 Oct 03 13:01:12.389627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:12.389627 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-fce698b3-674f-434f-9987-d4b587469f37 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Returning 404 to user: Instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 is not attached to volume a333f01f-4a0f-4e2b-a5b5-b954557f7a17 {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:01:12.391609 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-fce698b3-674f-434f-9987-d4b587469f37 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "DELETE /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3/os-volume_attachments/a333f01f-4a0f-4e2b-a5b5-b954557f7a17" status: 404 len: 154 microversion: 2.1 time: 0.105558 Oct 03 13:01:12.391609 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 529/1045] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 13:01:12 2022] DELETE /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3/os-volume_attachments/a333f01f-4a0f-4e2b-a5b5-b954557f7a17 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:01:13.648595 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-23af35bd-a963-41ef-af5f-9f56512fbc43 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:13.649216 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-23af35bd-a963-41ef-af5f-9f56512fbc43 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:13.655786 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-23af35bd-a963-41ef-af5f-9f56512fbc43 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:13.656295 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-23af35bd-a963-41ef-af5f-9f56512fbc43 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:13.656721 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-23af35bd-a963-41ef-af5f-9f56512fbc43 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:13.657451 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-23af35bd-a963-41ef-af5f-9f56512fbc43 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:13.657910 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-23af35bd-a963-41ef-af5f-9f56512fbc43 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:13.658358 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-23af35bd-a963-41ef-af5f-9f56512fbc43 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:13.684608 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-23af35bd-a963-41ef-af5f-9f56512fbc43 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Going to try to terminate instance {{(pid=127544) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:01:13.999603 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-23af35bd-a963-41ef-af5f-9f56512fbc43 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "DELETE /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 204 len: 0 microversion: 2.1 time: 0.354545 Oct 03 13:01:14.000200 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 517/1046] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 13:01:13 2022] DELETE /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:01:14.008454 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-bff02f71-e267-472e-8b64-f53be91d364e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:14.009060 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-bff02f71-e267-472e-8b64-f53be91d364e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:14.015594 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bff02f71-e267-472e-8b64-f53be91d364e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:14.016071 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bff02f71-e267-472e-8b64-f53be91d364e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:14.016507 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bff02f71-e267-472e-8b64-f53be91d364e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:14.017195 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bff02f71-e267-472e-8b64-f53be91d364e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:14.017646 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bff02f71-e267-472e-8b64-f53be91d364e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:14.018072 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bff02f71-e267-472e-8b64-f53be91d364e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:14.175629 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-bff02f71-e267-472e-8b64-f53be91d364e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:01:14.183504 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-bff02f71-e267-472e-8b64-f53be91d364e tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1555 microversion: 2.1 time: 0.178927 Oct 03 13:01:14.184075 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 530/1047] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:01:14 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:01:15.207234 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-e8070015-da91-448b-a8cf-8bf30b5d0332 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:15.207951 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-e8070015-da91-448b-a8cf-8bf30b5d0332 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:15.214578 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e8070015-da91-448b-a8cf-8bf30b5d0332 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:15.215064 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e8070015-da91-448b-a8cf-8bf30b5d0332 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:15.215531 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e8070015-da91-448b-a8cf-8bf30b5d0332 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:15.216228 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e8070015-da91-448b-a8cf-8bf30b5d0332 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:15.216684 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e8070015-da91-448b-a8cf-8bf30b5d0332 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:15.217110 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-e8070015-da91-448b-a8cf-8bf30b5d0332 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:15.284996 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-b4a4f629-f583-4120-b81a-8ea00e0d7df7 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Action: 'create', calling method: .version_select at 0x7fc740275790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1876342836"}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:01:15.353603 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-e8070015-da91-448b-a8cf-8bf30b5d0332 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:01:15.361189 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-e8070015-da91-448b-a8cf-8bf30b5d0332 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1555 microversion: 2.1 time: 0.158297 Oct 03 13:01:15.361943 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 531/1048] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:01:15 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:01:15.974989 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-b4a4f629-f583-4120-b81a-8ea00e0d7df7 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.810867 Oct 03 13:01:15.975723 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 518/1049] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Oct 3 13:01:15 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 812 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 03 13:01:15.988996 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c764fec8-f2a3-49e0-8103-40432e12c830 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Calling method '.version_select at 0x7fc740556820>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:16.038328 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c764fec8-f2a3-49e0-8103-40432e12c830 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/02be86ab-027b-47bc-a34f-3a247db2db80" status: 200 len: 345 microversion: 2.1 time: 0.053322 Oct 03 13:01:16.044753 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 532/1050] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 13:01:15 2022] GET /compute/v2.1/os-volumes/02be86ab-027b-47bc-a34f-3a247db2db80 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:01:16.323385 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-4864faff-21e3-411c-b0fc-461062bd942c req-fcfae54b-1325-4d89-af72-ff058f5d541d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "229aaf8a-e3ce-4319-94b4-7e22662880b3", "name": "network-vif-deleted", "tag": "f317c1e2-f283-4fec-bf28-0094dfcd58ff"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:01:16.334267 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-4864faff-21e3-411c-b0fc-461062bd942c req-fcfae54b-1325-4d89-af72-ff058f5d541d service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:16.334873 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-4864faff-21e3-411c-b0fc-461062bd942c req-fcfae54b-1325-4d89-af72-ff058f5d541d service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:16.335419 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-4864faff-21e3-411c-b0fc-461062bd942c req-fcfae54b-1325-4d89-af72-ff058f5d541d service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:16.345782 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-4864faff-21e3-411c-b0fc-461062bd942c req-fcfae54b-1325-4d89-af72-ff058f5d541d service nova] Creating event network-vif-deleted:f317c1e2-f283-4fec-bf28-0094dfcd58ff for instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 on hv-cinder-84456 Oct 03 13:01:16.350637 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-4864faff-21e3-411c-b0fc-461062bd942c req-fcfae54b-1325-4d89-af72-ff058f5d541d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031483 Oct 03 13:01:16.351237 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 519/1051] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 13:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:01:16.386153 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-21abf300-edaf-404f-9b91-c8ef4d2170be tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:16.386853 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-21abf300-edaf-404f-9b91-c8ef4d2170be tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:16.392762 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21abf300-edaf-404f-9b91-c8ef4d2170be tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:16.393257 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21abf300-edaf-404f-9b91-c8ef4d2170be tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:16.393717 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21abf300-edaf-404f-9b91-c8ef4d2170be tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:16.395069 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21abf300-edaf-404f-9b91-c8ef4d2170be tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:16.395514 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21abf300-edaf-404f-9b91-c8ef4d2170be tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:16.395948 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-21abf300-edaf-404f-9b91-c8ef4d2170be tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:16.458288 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-21abf300-edaf-404f-9b91-c8ef4d2170be tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a9a635aaf44c7b81224a6b0ad9dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a4271779a04986bbd34e2e989f3603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:01:16.466740 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-21abf300-edaf-404f-9b91-c8ef4d2170be tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 200 len: 1513 microversion: 2.1 time: 0.084884 Oct 03 13:01:16.467323 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 533/1052] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:01:16 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 1513 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:01:17.053762 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-dd7b3554-c828-4833-95d2-f0d5eca201bb tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Calling method '.version_select at 0x7fc740275310>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:17.102926 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-dd7b3554-c828-4833-95d2-f0d5eca201bb tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/02be86ab-027b-47bc-a34f-3a247db2db80" status: 200 len: 346 microversion: 2.1 time: 0.053991 Oct 03 13:01:17.103635 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 520/1053] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 13:01:17 2022] GET /compute/v2.1/os-volumes/02be86ab-027b-47bc-a34f-3a247db2db80 => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:01:17.117207 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-42845889-34a1-4494-ada4-399fb4149a18 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Action: 'create', calling method: .version_select at 0x7fc74020e430>, body: {"snapshot": {"volume_id": "02be86ab-027b-47bc-a34f-3a247db2db80", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-538744804"}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:01:17.490124 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-1a5886ef-5db0-42a0-ae8a-03e533c89df5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:17.490903 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-1a5886ef-5db0-42a0-ae8a-03e533c89df5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] [instance: 229aaf8a-e3ce-4319-94b4-7e22662880b3] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:01:17.497468 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1a5886ef-5db0-42a0-ae8a-03e533c89df5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:17.497939 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1a5886ef-5db0-42a0-ae8a-03e533c89df5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:17.498377 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1a5886ef-5db0-42a0-ae8a-03e533c89df5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:17.499075 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1a5886ef-5db0-42a0-ae8a-03e533c89df5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:01:17.499560 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1a5886ef-5db0-42a0-ae8a-03e533c89df5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:01:17.500090 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-1a5886ef-5db0-42a0-ae8a-03e533c89df5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:01:17.513624 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-1a5886ef-5db0-42a0-ae8a-03e533c89df5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] HTTP exception thrown: Instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 could not be found. Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-1a5886ef-5db0-42a0-ae8a-03e533c89df5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Request method failure captured: Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 HTTP/1.1 Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOtyXoyZgXyPcw-g5PGjf6VzhQAhWxu2EzFDNyH9YO3cGW7H1Xtw9NXugoIMBMkUlU8YB5RGTbH9vh_aUPayDASoxlFzuTywlMtvr5fypLyk157-LmitmDhlex1hqxnngcCPf3xHUq8E_DKknIUeyPIAaHFmkJMGjotYR4aTOsDmOYhM Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: a0a4271779a04986bbd34e2e989f3603 Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-TestMinimumBasicScenario-2034714005 Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 13:01:17.515247 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 13:01:17.516783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a0a4271779a04986bbd34e2e989f3603"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a0a4271779a04986bbd34e2e989f3603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a0a4271779a04986bbd34e2e989f3603"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a0a4271779a04986bbd34e2e989f3603"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:01:17.516783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-TestMinimumBasicScenario-2034714005 Oct 03 13:01:17.516783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: a0a4271779a04986bbd34e2e989f3603 Oct 03 13:01:17.516783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2034714005 Oct 03 13:01:17.516783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-TestMinimumBasicScenario-2034714005-project Oct 03 13:01:17.516783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 13:01:17.516783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 13:01:17.516783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: 9a4a9a635aaf44c7b81224a6b0ad9dec Oct 03 13:01:17.516783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-TestMinimumBasicScenario-2034714005-project Oct 03 13:01:17.516783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: > Oct 03 13:01:17.516783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 could not be found. Oct 03 13:01:17.516783 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': '229aaf8a-e3ce-4319-94b4-7e22662880b3'} Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 could not be found. Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:01:17.517575 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 could not be found. Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 could not be found. Oct 03 13:01:17.518881 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:17.520078 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-1a5886ef-5db0-42a0-ae8a-03e533c89df5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Returning 404 to user: Instance 229aaf8a-e3ce-4319-94b4-7e22662880b3 could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:01:17.520078 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-1a5886ef-5db0-42a0-ae8a-03e533c89df5 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3" status: 404 len: 111 microversion: 2.1 time: 0.031027 Oct 03 13:01:17.520078 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 521/1054] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:01:17 2022] GET /compute/v2.1/servers/229aaf8a-e3ce-4319-94b4-7e22662880b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 13:01:17.525655 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-01258208-f75a-4fbf-ba98-60fd4fb2b2e0 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] Calling method '.version_select at 0x7fc740275c10>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:17.624137 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-42845889-34a1-4494-ada4-399fb4149a18 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.511391 Oct 03 13:01:17.624850 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 534/1055] 10.222.0.33 () {60 vars in 1162 bytes} [Mon Oct 3 13:01:17 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:01:17.635882 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f26eb428-cef1-4b77-89bf-957e25b88368 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Calling method '.version_select at 0x7fc7402143a0>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:17.648826 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-01258208-f75a-4fbf-ba98-60fd4fb2b2e0 tempest-TestMinimumBasicScenario-2034714005 tempest-TestMinimumBasicScenario-2034714005-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2032278945" status: 202 len: 0 microversion: 2.1 time: 0.122379 Oct 03 13:01:17.648826 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 522/1056] 10.222.0.33 () {58 vars in 1272 bytes} [Mon Oct 3 13:01:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2032278945 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 13:01:17.669336 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f26eb428-cef1-4b77-89bf-957e25b88368 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/207233b3-a00f-4ff1-81fd-79df12a3c8db" status: 200 len: 286 microversion: 2.1 time: 0.037135 Oct 03 13:01:17.670070 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 535/1057] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Oct 3 13:01:17 2022] GET /compute/v2.1/os-snapshots/207233b3-a00f-4ff1-81fd-79df12a3c8db => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:01:17.681838 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-bbae751f-2865-44ba-9518-fa64c5a4e79b tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Calling method '.version_select at 0x7fc740258c10>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:17.714743 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-bbae751f-2865-44ba-9518-fa64c5a4e79b tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037743 Oct 03 13:01:17.721515 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 523/1058] 10.222.0.33 () {58 vars in 1140 bytes} [Mon Oct 3 13:01:17 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:01:17.729139 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7da52f47-9c0a-407e-be9c-c0c5332c44b3 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Calling method '.version_select at 0x7fc74029bb80>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:17.760432 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-7da52f47-9c0a-407e-be9c-c0c5332c44b3 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/207233b3-a00f-4ff1-81fd-79df12a3c8db" status: 200 len: 286 microversion: 2.1 time: 0.037394 Oct 03 13:01:17.765586 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 536/1059] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Oct 3 13:01:17 2022] GET /compute/v2.1/os-snapshots/207233b3-a00f-4ff1-81fd-79df12a3c8db => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:01:18.774448 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-7412fb75-1a2d-4e5f-ac08-300958ae2005 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Calling method '.version_select at 0x7fc740553dc0>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:18.805027 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-7412fb75-1a2d-4e5f-ac08-300958ae2005 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/207233b3-a00f-4ff1-81fd-79df12a3c8db" status: 200 len: 286 microversion: 2.1 time: 0.035631 Oct 03 13:01:18.805766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 524/1060] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Oct 3 13:01:18 2022] GET /compute/v2.1/os-snapshots/207233b3-a00f-4ff1-81fd-79df12a3c8db => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:01:19.819237 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-04fb8cf0-db41-45f0-ace5-d3eb46b7ae25 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Calling method '.version_select at 0x7fc74039adc0>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:19.851708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-04fb8cf0-db41-45f0-ace5-d3eb46b7ae25 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/207233b3-a00f-4ff1-81fd-79df12a3c8db" status: 200 len: 286 microversion: 2.1 time: 0.037673 Oct 03 13:01:19.852420 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 537/1061] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Oct 3 13:01:19 2022] GET /compute/v2.1/os-snapshots/207233b3-a00f-4ff1-81fd-79df12a3c8db => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:01:20.865588 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e8f17779-512b-4358-98d1-2a125aac5a96 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Calling method '.version_select at 0x7fc740323ee0>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:20.902560 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e8f17779-512b-4358-98d1-2a125aac5a96 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/207233b3-a00f-4ff1-81fd-79df12a3c8db" status: 200 len: 287 microversion: 2.1 time: 0.041306 Oct 03 13:01:20.903167 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 525/1062] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Oct 3 13:01:20 2022] GET /compute/v2.1/os-snapshots/207233b3-a00f-4ff1-81fd-79df12a3c8db => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:01:20.919224 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ee274855-08da-4ff9-ac68-5b25400a29e8 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Calling method '.version_select at 0x7fc740556dc0>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:21.040550 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-ee274855-08da-4ff9-ac68-5b25400a29e8 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/207233b3-a00f-4ff1-81fd-79df12a3c8db" status: 202 len: 0 microversion: 2.1 time: 0.125735 Oct 03 13:01:21.041421 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 538/1063] 10.222.0.33 () {58 vars in 1254 bytes} [Mon Oct 3 13:01:20 2022] DELETE /compute/v2.1/os-snapshots/207233b3-a00f-4ff1-81fd-79df12a3c8db => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:01:21.049811 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-943d2c54-bd8d-43a1-bbc1-2cd782bd03d5 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Calling method '.version_select at 0x7fc74040adc0>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:21.082201 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-943d2c54-bd8d-43a1-bbc1-2cd782bd03d5 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/207233b3-a00f-4ff1-81fd-79df12a3c8db" status: 200 len: 286 microversion: 2.1 time: 0.036223 Oct 03 13:01:21.083017 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 526/1064] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Oct 3 13:01:21 2022] GET /compute/v2.1/os-snapshots/207233b3-a00f-4ff1-81fd-79df12a3c8db => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:01:22.111161 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-10673f5b-f17e-42c7-a6c0-9923575f5c30 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Calling method '.version_select at 0x7fc74025e280>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:22.128501 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-10673f5b-f17e-42c7-a6c0-9923575f5c30 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] HTTP exception thrown: Snapshot 207233b3-a00f-4ff1-81fd-79df12a3c8db could not be found. Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-10673f5b-f17e-42c7-a6c0-9923575f5c30 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Request method failure captured: Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/os-snapshots/207233b3-a00f-4ff1-81fd-79df12a3c8db HTTP/1.1 Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOt0bAsS_ZRHJz4H6Z6sH9ID2mYZT7HfpiGW8eJqhzfqO7KkvX6cK73Hltewp_-3PpfDYQdQ3HbHPBziU3GWbp4lxUiA59qsD8sSu4axExgiST8CpjlrDYgbsgQEPXPIZZYeXq3_QzQElUBeFNCc-LVW_gHKFpRwjMxhBwaBE9bIq5h4 Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 013a17c83cf44302b0705de04214140e Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-990474356 Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 13:01:22.130708 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 13:01:22.132337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_013a17c83cf44302b0705de04214140e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/013a17c83cf44302b0705de04214140e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/013a17c83cf44302b0705de04214140e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/013a17c83cf44302b0705de04214140e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:01:22.132337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-VolumesSnapshotsTestJSON-990474356 Oct 03 13:01:22.132337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 013a17c83cf44302b0705de04214140e Oct 03 13:01:22.132337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-990474356 Oct 03 13:01:22.132337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-VolumesSnapshotsTestJSON-990474356-project Oct 03 13:01:22.132337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 13:01:22.132337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 13:01:22.132337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: d5a8888fcc784bdb9d5c6ebf7359dbc2 Oct 03 13:01:22.132337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-VolumesSnapshotsTestJSON-990474356-project Oct 03 13:01:22.132337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: Oct 03 13:01:22.132337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Snapshot 207233b3-a00f-4ff1-81fd-79df12a3c8db could not be found. Oct 03 13:01:22.132337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': '207233b3-a00f-4ff1-81fd-79df12a3c8db'} Oct 03 13:01:22.132337 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 207233b3-a00f-4ff1-81fd-79df12a3c8db could not be found. (HTTP 404) (Request-ID: req-d61a8495-6cd1-4090-9fd2-fcabbe4b57e8) Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:22.136676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 13:01:22.138088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 207233b3-a00f-4ff1-81fd-79df12a3c8db could not be found. Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 03 13:01:22.139525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:01:22.141088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 207233b3-a00f-4ff1-81fd-79df12a3c8db could not be found. Oct 03 13:01:22.141088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:22.141088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:22.141088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:22.141088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:22.141088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:22.141088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:22.141088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:01:22.141088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:01:22.141088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 207233b3-a00f-4ff1-81fd-79df12a3c8db could not be found. Oct 03 13:01:22.141088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:22.141088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-10673f5b-f17e-42c7-a6c0-9923575f5c30 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Returning 404 to user: Snapshot 207233b3-a00f-4ff1-81fd-79df12a3c8db could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:01:22.141088 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-10673f5b-f17e-42c7-a6c0-9923575f5c30 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/207233b3-a00f-4ff1-81fd-79df12a3c8db" status: 404 len: 111 microversion: 2.1 time: 0.040766 Oct 03 13:01:22.142101 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 539/1065] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Oct 3 13:01:22 2022] GET /compute/v2.1/os-snapshots/207233b3-a00f-4ff1-81fd-79df12a3c8db => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:01:22.148163 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-75235828-5ad4-4a2d-a6f8-5f175abfd6c9 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Calling method '.version_select at 0x7fc7402c6550>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:22.384729 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-75235828-5ad4-4a2d-a6f8-5f175abfd6c9 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/02be86ab-027b-47bc-a34f-3a247db2db80" status: 202 len: 0 microversion: 2.1 time: 0.241117 Oct 03 13:01:22.385366 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 527/1066] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 13:01:22 2022] DELETE /compute/v2.1/os-volumes/02be86ab-027b-47bc-a34f-3a247db2db80 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:01:22.393676 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-61f6104f-8fad-4d94-9011-e8dbaf2bd1fe tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Calling method '.version_select at 0x7fc7400b1670>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:22.446690 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-61f6104f-8fad-4d94-9011-e8dbaf2bd1fe tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/02be86ab-027b-47bc-a34f-3a247db2db80" status: 200 len: 345 microversion: 2.1 time: 0.056956 Oct 03 13:01:22.447392 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 540/1067] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 13:01:22 2022] GET /compute/v2.1/os-volumes/02be86ab-027b-47bc-a34f-3a247db2db80 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:01:23.463031 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8346510c-d51e-4643-8fa6-7b5c7ff6399f tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Calling method '.version_select at 0x7fc743a408b0>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:23.492118 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-8346510c-d51e-4643-8fa6-7b5c7ff6399f tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] HTTP exception thrown: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8346510c-d51e-4643-8fa6-7b5c7ff6399f tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Request method failure captured: Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: GET /compute/v2.1/os-volumes/02be86ab-027b-47bc-a34f-3a247db2db80 HTTP/1.1 Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOt0bAsS_ZRHJz4H6Z6sH9ID2mYZT7HfpiGW8eJqhzfqO7KkvX6cK73Hltewp_-3PpfDYQdQ3HbHPBziU3GWbp4lxUiA59qsD8sSu4axExgiST8CpjlrDYgbsgQEPXPIZZYeXq3_QzQElUBeFNCc-LVW_gHKFpRwjMxhBwaBE9bIq5h4 Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: 013a17c83cf44302b0705de04214140e Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-990474356 Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 13:01:23.494764 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 13:01:23.496452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_013a17c83cf44302b0705de04214140e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/013a17c83cf44302b0705de04214140e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/013a17c83cf44302b0705de04214140e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/013a17c83cf44302b0705de04214140e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:01:23.496452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-VolumesSnapshotsTestJSON-990474356 Oct 03 13:01:23.496452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: 013a17c83cf44302b0705de04214140e Oct 03 13:01:23.496452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-990474356 Oct 03 13:01:23.496452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-VolumesSnapshotsTestJSON-990474356-project Oct 03 13:01:23.496452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 13:01:23.496452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 13:01:23.496452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: d5a8888fcc784bdb9d5c6ebf7359dbc2 Oct 03 13:01:23.496452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-VolumesSnapshotsTestJSON-990474356-project Oct 03 13:01:23.496452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: Oct 03 13:01:23.496452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. Oct 03 13:01:23.496452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': '02be86ab-027b-47bc-a34f-3a247db2db80'} Oct 03 13:01:23.496452 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. (HTTP 404) (Request-ID: req-11750bcb-3701-4669-9ce4-67833a96b153) Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:23.497766 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 13:01:23.499223 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 13:01:23.500674 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:01:23.502112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. Oct 03 13:01:23.502112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.502112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:23.502112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.502112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:23.502112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:23.502112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:23.502112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:01:23.502112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:01:23.502112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. Oct 03 13:01:23.502112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.502112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-8346510c-d51e-4643-8fa6-7b5c7ff6399f tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Returning 404 to user: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:01:23.502112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-8346510c-d51e-4643-8fa6-7b5c7ff6399f tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/02be86ab-027b-47bc-a34f-3a247db2db80" status: 404 len: 109 microversion: 2.1 time: 0.038651 Oct 03 13:01:23.502112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 528/1068] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 13:01:23 2022] GET /compute/v2.1/os-volumes/02be86ab-027b-47bc-a34f-3a247db2db80 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:01:23.510622 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0cbd2244-ef14-434c-97fd-dc63c3549865 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Calling method '.version_select at 0x7fc740395ee0>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:23.540421 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-0cbd2244-ef14-434c-97fd-dc63c3549865 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] HTTP exception thrown: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0cbd2244-ef14-434c-97fd-dc63c3549865 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Request method failure captured: Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: DELETE /compute/v2.1/os-volumes/02be86ab-027b-47bc-a34f-3a247db2db80 HTTP/1.1 Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOt0bAsS_ZRHJz4H6Z6sH9ID2mYZT7HfpiGW8eJqhzfqO7KkvX6cK73Hltewp_-3PpfDYQdQ3HbHPBziU3GWbp4lxUiA59qsD8sSu4axExgiST8CpjlrDYgbsgQEPXPIZZYeXq3_QzQElUBeFNCc-LVW_gHKFpRwjMxhBwaBE9bIq5h4 Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 013a17c83cf44302b0705de04214140e Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-990474356 Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 13:01:23.542406 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 13:01:23.544016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_013a17c83cf44302b0705de04214140e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/013a17c83cf44302b0705de04214140e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/013a17c83cf44302b0705de04214140e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/013a17c83cf44302b0705de04214140e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:01:23.544016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-VolumesSnapshotsTestJSON-990474356 Oct 03 13:01:23.544016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 013a17c83cf44302b0705de04214140e Oct 03 13:01:23.544016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-990474356 Oct 03 13:01:23.544016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-VolumesSnapshotsTestJSON-990474356-project Oct 03 13:01:23.544016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 13:01:23.544016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 13:01:23.544016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: d5a8888fcc784bdb9d5c6ebf7359dbc2 Oct 03 13:01:23.544016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-VolumesSnapshotsTestJSON-990474356-project Oct 03 13:01:23.544016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: Oct 03 13:01:23.544016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. Oct 03 13:01:23.544016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': '02be86ab-027b-47bc-a34f-3a247db2db80'} Oct 03 13:01:23.544016 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. (HTTP 404) (Request-ID: req-4ab52982-4433-4587-9323-2e9f0f97b6d5) Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:23.544983 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 13:01:23.546405 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 13:01:23.548326 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:01:23.549839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. Oct 03 13:01:23.549839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.549839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:23.549839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.549839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:23.549839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:23.549839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:23.549839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:01:23.549839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:01:23.549839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. Oct 03 13:01:23.549839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.549839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-0cbd2244-ef14-434c-97fd-dc63c3549865 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Returning 404 to user: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:01:23.549839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-0cbd2244-ef14-434c-97fd-dc63c3549865 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/02be86ab-027b-47bc-a34f-3a247db2db80" status: 404 len: 109 microversion: 2.1 time: 0.037559 Oct 03 13:01:23.549839 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 541/1069] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 13:01:23 2022] DELETE /compute/v2.1/os-volumes/02be86ab-027b-47bc-a34f-3a247db2db80 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:01:23.553139 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-72a9f8e5-725b-4a2e-97e7-98f84e209579 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Calling method '.version_select at 0x7fc740275c10>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:01:23.580342 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.wsgi [None req-72a9f8e5-725b-4a2e-97e7-98f84e209579 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] HTTP exception thrown: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-72a9f8e5-725b-4a2e-97e7-98f84e209579 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Request method failure captured: Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: request: GET /compute/v2.1/os-volumes/02be86ab-027b-47bc-a34f-3a247db2db80 HTTP/1.1 Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept: application/json Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Accept-Encoding: identity Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Connection: close Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Length: 0 Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Content-Type: application/json Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Host: 10.222.0.33 Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Openstack-System-Scope: None Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: User-Agent: python-urllib3/1.26.12 Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Auth-Token: gAAAAABjOt0bAsS_ZRHJz4H6Z6sH9ID2mYZT7HfpiGW8eJqhzfqO7KkvX6cK73Hltewp_-3PpfDYQdQ3HbHPBziU3GWbp4lxUiA59qsD8sSu4axExgiST8CpjlrDYgbsgQEPXPIZZYeXq3_QzQElUBeFNCc-LVW_gHKFpRwjMxhBwaBE9bIq5h4 Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Id: None Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Domain-Name: None Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Identity-Status: Confirmed Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Is-Admin-Project: True Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Id: default Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Domain-Name: Default Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Id: 013a17c83cf44302b0705de04214140e Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-990474356 Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Role: member,reader Oct 03 13:01:23.582389 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Roles: member,reader Oct 03 13:01:23.584629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_013a17c83cf44302b0705de04214140e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/013a17c83cf44302b0705de04214140e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/013a17c83cf44302b0705de04214140e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/013a17c83cf44302b0705de04214140e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:01:23.584629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant: tempest-VolumesSnapshotsTestJSON-990474356 Oct 03 13:01:23.584629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Id: 013a17c83cf44302b0705de04214140e Oct 03 13:01:23.584629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-990474356 Oct 03 13:01:23.584629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User: tempest-VolumesSnapshotsTestJSON-990474356-project Oct 03 13:01:23.584629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Id: default Oct 03 13:01:23.584629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Domain-Name: Default Oct 03 13:01:23.584629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Id: d5a8888fcc784bdb9d5c6ebf7359dbc2 Oct 03 13:01:23.584629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: X-User-Name: tempest-VolumesSnapshotsTestJSON-990474356-project Oct 03 13:01:23.584629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: method: Oct 03 13:01:23.584629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: exception: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. Oct 03 13:01:23.584629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: action_args: {'id': '02be86ab-027b-47bc-a34f-3a247db2db80'} Oct 03 13:01:23.584629 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. (HTTP 404) (Request-ID: req-a61036e2-3ca4-4a17-97ff-7a8a7f1c747d) Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:23.585724 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 13:01:23.587159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 13:01:23.589285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:01:23.590964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. Oct 03 13:01:23.590964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.590964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:01:23.590964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.590964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:01:23.590964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:01:23.590964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:01:23.590964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:01:23.590964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:01:23.590964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. Oct 03 13:01:23.590964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: ERROR nova.api.openstack.wsgi Oct 03 13:01:23.590964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-72a9f8e5-725b-4a2e-97e7-98f84e209579 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] Returning 404 to user: Volume 02be86ab-027b-47bc-a34f-3a247db2db80 could not be found. {{(pid=127544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:01:23.590964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-72a9f8e5-725b-4a2e-97e7-98f84e209579 tempest-VolumesSnapshotsTestJSON-990474356 tempest-VolumesSnapshotsTestJSON-990474356-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/02be86ab-027b-47bc-a34f-3a247db2db80" status: 404 len: 109 microversion: 2.1 time: 0.035912 Oct 03 13:01:23.590964 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 529/1070] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 13:01:23 2022] GET /compute/v2.1/os-volumes/02be86ab-027b-47bc-a34f-3a247db2db80 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 13:02:04.581961 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:02:04.582720 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:02:04.587691 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1939126174", "imageRef": "9d585789-e496-433d-b311-70ec7ceffd99", "flavorRef": "452", "networks": [{"uuid": "739c13ba-8ecd-4b6d-b542-b58a60650305"}]}} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:02:04.640213 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.network.neutron [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] validate_networks() for [('739c13ba-8ecd-4b6d-b542-b58a60650305', None, None, None, None, None)] {{(pid=127542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:02:05.037642 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Flavor limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:02:05.038069 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Image limits 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:02:05.038655 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Flavor pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:02:05.039331 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Image pref 0:0:0 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:02:05.039759 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.virt.hardware [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:02:05.048840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:05.049324 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:05.049761 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:05.053859 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:05.053859 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:05.053859 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:05.069354 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Getting quotas for project 9421d499349f4d90b729021b00961cf2. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:02:05.076140 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.quota [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Getting quotas for user 5a67a58ae60a4e13a3bfe77462c4337e and project 9421d499349f4d90b729021b00961cf2. Resources: {'ram', 'cores', 'instances'} {{(pid=127542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:02:05.089952 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Going to run 1 instances... {{(pid=127542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:02:05.094883 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d585789-e496-433d-b311-70ec7ceffd99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:02:05.241403 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-ae10d231-42ab-42b6-954b-d25ba320acf4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661145 Oct 03 13:02:05.242056 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 542/1071] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 13:02:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 13:02:05.252329 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:02:05.252858 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:02:05.257938 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-f34a9d16-2b5d-4767-9b87-75fd2832d9e5 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:02:05.258560 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-f34a9d16-2b5d-4767-9b87-75fd2832d9e5 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:02:05.314703 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-f34a9d16-2b5d-4767-9b87-75fd2832d9e5 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:02:05.322277 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-f34a9d16-2b5d-4767-9b87-75fd2832d9e5 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928" status: 200 len: 1219 microversion: 2.1 time: 0.071160 Oct 03 13:02:05.323119 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 530/1072] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:02:05 2022] GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:02:06.345985 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7b31acab-f99c-47e1-bc2e-87d6ffc6a324 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:02:06.346589 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-7b31acab-f99c-47e1-bc2e-87d6ffc6a324 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:02:06.403993 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-7b31acab-f99c-47e1-bc2e-87d6ffc6a324 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:02:06.410842 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-7b31acab-f99c-47e1-bc2e-87d6ffc6a324 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928" status: 200 len: 1219 microversion: 2.1 time: 0.069491 Oct 03 13:02:06.411596 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 543/1073] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:02:06 2022] GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:02:07.434862 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-abe474e7-aa37-4a02-80fc-15da810bba5f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:02:07.435565 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-abe474e7-aa37-4a02-80fc-15da810bba5f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:02:07.442810 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-abe474e7-aa37-4a02-80fc-15da810bba5f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:07.443296 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-abe474e7-aa37-4a02-80fc-15da810bba5f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:07.443759 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-abe474e7-aa37-4a02-80fc-15da810bba5f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:07.444458 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-abe474e7-aa37-4a02-80fc-15da810bba5f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:07.444916 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-abe474e7-aa37-4a02-80fc-15da810bba5f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:07.445341 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-abe474e7-aa37-4a02-80fc-15da810bba5f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:07.506971 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-abe474e7-aa37-4a02-80fc-15da810bba5f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:02:07.515285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-abe474e7-aa37-4a02-80fc-15da810bba5f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928" status: 200 len: 1271 microversion: 2.1 time: 0.085429 Oct 03 13:02:07.515878 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 531/1074] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:02:07 2022] GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:02:08.539344 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-fc13b551-0160-4441-948b-b58146c6a528 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:02:08.539993 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-fc13b551-0160-4441-948b-b58146c6a528 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:02:08.546493 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fc13b551-0160-4441-948b-b58146c6a528 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:08.547009 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fc13b551-0160-4441-948b-b58146c6a528 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:08.547483 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fc13b551-0160-4441-948b-b58146c6a528 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:08.548170 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fc13b551-0160-4441-948b-b58146c6a528 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:08.548624 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fc13b551-0160-4441-948b-b58146c6a528 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:08.549047 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fc13b551-0160-4441-948b-b58146c6a528 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:08.680528 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-fc13b551-0160-4441-948b-b58146c6a528 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:02:08.688871 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-fc13b551-0160-4441-948b-b58146c6a528 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928" status: 200 len: 1319 microversion: 2.1 time: 0.153395 Oct 03 13:02:08.689493 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 544/1075] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:02:08 2022] GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:02:09.349615 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-931aec74-4440-4408-b6dc-47b7b3cda643 req-ee504351-6d3e-4c34-9795-19224cc4d966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac401e60-5900-409b-8939-e86e844d7928", "tag": "efb683db-15da-417b-b1a9-903689b36df3"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:02:09.365112 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-931aec74-4440-4408-b6dc-47b7b3cda643 req-ee504351-6d3e-4c34-9795-19224cc4d966 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:09.365596 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-931aec74-4440-4408-b6dc-47b7b3cda643 req-ee504351-6d3e-4c34-9795-19224cc4d966 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:09.366024 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-931aec74-4440-4408-b6dc-47b7b3cda643 req-ee504351-6d3e-4c34-9795-19224cc4d966 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:09.377812 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-931aec74-4440-4408-b6dc-47b7b3cda643 req-ee504351-6d3e-4c34-9795-19224cc4d966 service nova] Creating event network-changed:efb683db-15da-417b-b1a9-903689b36df3 for instance ac401e60-5900-409b-8939-e86e844d7928 on hv-cinder-84456 Oct 03 13:02:09.382770 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-931aec74-4440-4408-b6dc-47b7b3cda643 req-ee504351-6d3e-4c34-9795-19224cc4d966 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036901 Oct 03 13:02:09.383498 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 532/1076] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 13:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:02:09.712672 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b6fad3fb-dfe9-4737-8042-8922cdd79f0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:02:09.713348 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b6fad3fb-dfe9-4737-8042-8922cdd79f0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:02:09.720054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b6fad3fb-dfe9-4737-8042-8922cdd79f0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:09.720358 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b6fad3fb-dfe9-4737-8042-8922cdd79f0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:09.720800 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b6fad3fb-dfe9-4737-8042-8922cdd79f0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:09.721498 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b6fad3fb-dfe9-4737-8042-8922cdd79f0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:09.722048 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b6fad3fb-dfe9-4737-8042-8922cdd79f0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:09.722586 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b6fad3fb-dfe9-4737-8042-8922cdd79f0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:09.856330 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-b6fad3fb-dfe9-4737-8042-8922cdd79f0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:02:09.864007 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-b6fad3fb-dfe9-4737-8042-8922cdd79f0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928" status: 200 len: 1319 microversion: 2.1 time: 0.155444 Oct 03 13:02:09.864579 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 545/1077] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:02:09 2022] GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:02:10.888070 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-02622395-1d0f-4126-8294-d8b41b207024 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:02:10.888771 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-02622395-1d0f-4126-8294-d8b41b207024 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:02:10.894831 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02622395-1d0f-4126-8294-d8b41b207024 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:10.895339 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02622395-1d0f-4126-8294-d8b41b207024 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:10.895770 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02622395-1d0f-4126-8294-d8b41b207024 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:10.896465 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02622395-1d0f-4126-8294-d8b41b207024 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:10.896919 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02622395-1d0f-4126-8294-d8b41b207024 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:10.897346 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-02622395-1d0f-4126-8294-d8b41b207024 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:11.027391 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-02622395-1d0f-4126-8294-d8b41b207024 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:02:11.034995 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-02622395-1d0f-4126-8294-d8b41b207024 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928" status: 200 len: 1319 microversion: 2.1 time: 0.151588 Oct 03 13:02:11.035600 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 533/1078] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:02:10 2022] GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:02:12.064980 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-93068e32-62b0-4cab-8414-ac7aace2e035 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:02:12.065609 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-93068e32-62b0-4cab-8414-ac7aace2e035 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:02:12.072098 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-93068e32-62b0-4cab-8414-ac7aace2e035 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:12.073222 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-93068e32-62b0-4cab-8414-ac7aace2e035 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:12.073669 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-93068e32-62b0-4cab-8414-ac7aace2e035 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:12.074372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-93068e32-62b0-4cab-8414-ac7aace2e035 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:12.074837 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-93068e32-62b0-4cab-8414-ac7aace2e035 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:12.075372 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-93068e32-62b0-4cab-8414-ac7aace2e035 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:12.200079 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-93068e32-62b0-4cab-8414-ac7aace2e035 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:02:12.207615 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-93068e32-62b0-4cab-8414-ac7aace2e035 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928" status: 200 len: 1319 microversion: 2.1 time: 0.146526 Oct 03 13:02:12.208178 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 546/1079] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:02:12 2022] GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:02:13.230751 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-24209119-a2f0-4ac4-b267-62f5bf3a966c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:02:13.231437 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-24209119-a2f0-4ac4-b267-62f5bf3a966c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:02:13.243046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-24209119-a2f0-4ac4-b267-62f5bf3a966c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:13.243592 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-24209119-a2f0-4ac4-b267-62f5bf3a966c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:13.248997 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-24209119-a2f0-4ac4-b267-62f5bf3a966c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:13.249878 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-24209119-a2f0-4ac4-b267-62f5bf3a966c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:13.250360 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-24209119-a2f0-4ac4-b267-62f5bf3a966c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:13.250800 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-24209119-a2f0-4ac4-b267-62f5bf3a966c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:13.265020 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-e382e998-084d-4f24-b0bf-a83ac608be91 req-c0d2776e-e26d-4682-a5ab-bf6f29356330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac401e60-5900-409b-8939-e86e844d7928", "name": "network-vif-plugged", "status": "completed", "tag": "efb683db-15da-417b-b1a9-903689b36df3"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:02:13.274654 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-e382e998-084d-4f24-b0bf-a83ac608be91 req-c0d2776e-e26d-4682-a5ab-bf6f29356330 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:13.275246 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-e382e998-084d-4f24-b0bf-a83ac608be91 req-c0d2776e-e26d-4682-a5ab-bf6f29356330 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:13.276159 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-e382e998-084d-4f24-b0bf-a83ac608be91 req-c0d2776e-e26d-4682-a5ab-bf6f29356330 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:13.289429 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-e382e998-084d-4f24-b0bf-a83ac608be91 req-c0d2776e-e26d-4682-a5ab-bf6f29356330 service nova] Creating event network-vif-plugged:efb683db-15da-417b-b1a9-903689b36df3 for instance ac401e60-5900-409b-8939-e86e844d7928 on hv-cinder-84456 Oct 03 13:02:13.294326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-e382e998-084d-4f24-b0bf-a83ac608be91 req-c0d2776e-e26d-4682-a5ab-bf6f29356330 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156593 Oct 03 13:02:13.294925 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 534/1080] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 13:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:02:13.392905 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-24209119-a2f0-4ac4-b267-62f5bf3a966c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:02:13.401757 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-24209119-a2f0-4ac4-b267-62f5bf3a966c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928" status: 200 len: 1319 microversion: 2.1 time: 0.175292 Oct 03 13:02:13.402323 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 547/1081] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:02:13 2022] GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:02:14.425180 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-9d947d78-e29b-4cd6-8ce9-8dc9374ae42b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:02:14.425873 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-9d947d78-e29b-4cd6-8ce9-8dc9374ae42b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:02:14.432739 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d947d78-e29b-4cd6-8ce9-8dc9374ae42b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:14.433257 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d947d78-e29b-4cd6-8ce9-8dc9374ae42b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:14.433695 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d947d78-e29b-4cd6-8ce9-8dc9374ae42b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:14.434385 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d947d78-e29b-4cd6-8ce9-8dc9374ae42b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:14.434874 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d947d78-e29b-4cd6-8ce9-8dc9374ae42b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:14.435299 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-9d947d78-e29b-4cd6-8ce9-8dc9374ae42b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:14.567840 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-9d947d78-e29b-4cd6-8ce9-8dc9374ae42b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:02:14.575412 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-9d947d78-e29b-4cd6-8ce9-8dc9374ae42b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928" status: 200 len: 1319 microversion: 2.1 time: 0.154392 Oct 03 13:02:14.575955 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 535/1082] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:02:14 2022] GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:02:15.598964 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f37aaea4-80cd-4874-91ed-93a6b7389e36 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:02:15.599525 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f37aaea4-80cd-4874-91ed-93a6b7389e36 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:02:15.601801 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:02:15.607041 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f37aaea4-80cd-4874-91ed-93a6b7389e36 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:15.607558 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f37aaea4-80cd-4874-91ed-93a6b7389e36 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:15.607994 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f37aaea4-80cd-4874-91ed-93a6b7389e36 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:15.608726 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f37aaea4-80cd-4874-91ed-93a6b7389e36 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:15.609179 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f37aaea4-80cd-4874-91ed-93a6b7389e36 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:15.609607 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f37aaea4-80cd-4874-91ed-93a6b7389e36 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:15.738805 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-f37aaea4-80cd-4874-91ed-93a6b7389e36 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:02:15.746672 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f37aaea4-80cd-4874-91ed-93a6b7389e36 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928" status: 200 len: 1508 microversion: 2.1 time: 0.151701 Oct 03 13:02:15.747235 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 548/1083] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:02:15 2022] GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:02:31.235553 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-11484e8c-3ae0-49d3-b0c6-b08e27aa2558 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08d9ded8-a00d-4fe3-b9d5-e5600d131e1f", "device": "/dev/sdb"}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:02:31.238413 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-11484e8c-3ae0-49d3-b0c6-b08e27aa2558 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:02:31.240455 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=2 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:02:31.241594 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=14 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:02:31.242227 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=22 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:02:31.247191 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11484e8c-3ae0-49d3-b0c6-b08e27aa2558 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:31.247714 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11484e8c-3ae0-49d3-b0c6-b08e27aa2558 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:31.248160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11484e8c-3ae0-49d3-b0c6-b08e27aa2558 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:31.248871 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11484e8c-3ae0-49d3-b0c6-b08e27aa2558 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:31.249324 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11484e8c-3ae0-49d3-b0c6-b08e27aa2558 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:31.249753 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-11484e8c-3ae0-49d3-b0c6-b08e27aa2558 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:32.070197 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-11484e8c-3ae0-49d3-b0c6-b08e27aa2558 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "POST /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.838365 Oct 03 13:02:32.070986 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 536/1084] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 13:02:31 2022] POST /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928/os-volume_attachments => generated 194 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:02:56.870991 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-d0eadd00-5a70-40c5-9520-3cb3b834ecc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:02:56.871519 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-d0eadd00-5a70-40c5-9520-3cb3b834ecc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:02:56.873361 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=8 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:02:56.874107 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:02:56.874874 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=32 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:02:56.880311 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d0eadd00-5a70-40c5-9520-3cb3b834ecc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:56.886314 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d0eadd00-5a70-40c5-9520-3cb3b834ecc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:56.886314 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d0eadd00-5a70-40c5-9520-3cb3b834ecc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:56.886314 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d0eadd00-5a70-40c5-9520-3cb3b834ecc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:56.886314 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d0eadd00-5a70-40c5-9520-3cb3b834ecc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:56.886746 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-d0eadd00-5a70-40c5-9520-3cb3b834ecc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:56.966375 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-d0eadd00-5a70-40c5-9520-3cb3b834ecc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lazy-loading 'services' on Instance uuid ac401e60-5900-409b-8939-e86e844d7928 {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:02:57.185202 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-d0eadd00-5a70-40c5-9520-3cb3b834ecc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928/os-volume_attachments/08d9ded8-a00d-4fe3-b9d5-e5600d131e1f" status: 202 len: 0 microversion: 2.1 time: 0.318333 Oct 03 13:02:57.185900 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 549/1085] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 13:02:56 2022] DELETE /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928/os-volume_attachments/08d9ded8-a00d-4fe3-b9d5-e5600d131e1f => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:02:58.311541 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-a11a744e-6865-49a6-8a3c-b10f0a9f3882 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:02:58.312133 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a11a744e-6865-49a6-8a3c-b10f0a9f3882 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:02:58.314781 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=2 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:02:58.315480 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:02:58.320335 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a11a744e-6865-49a6-8a3c-b10f0a9f3882 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:58.320840 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a11a744e-6865-49a6-8a3c-b10f0a9f3882 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:58.321264 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a11a744e-6865-49a6-8a3c-b10f0a9f3882 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:58.321952 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a11a744e-6865-49a6-8a3c-b10f0a9f3882 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:58.322406 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a11a744e-6865-49a6-8a3c-b10f0a9f3882 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:58.322858 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-a11a744e-6865-49a6-8a3c-b10f0a9f3882 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:58.350493 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-a11a744e-6865-49a6-8a3c-b10f0a9f3882 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Going to try to terminate instance {{(pid=127544) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:02:58.694401 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-a11a744e-6865-49a6-8a3c-b10f0a9f3882 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928" status: 204 len: 0 microversion: 2.1 time: 0.386890 Oct 03 13:02:58.694997 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 537/1086] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 13:02:58 2022] DELETE /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:02:58.704534 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-bbb1e7bd-14cb-4fcc-9891-6d4b0a8c8fbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:02:58.705237 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-bbb1e7bd-14cb-4fcc-9891-6d4b0a8c8fbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:02:58.711546 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bbb1e7bd-14cb-4fcc-9891-6d4b0a8c8fbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:58.712032 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bbb1e7bd-14cb-4fcc-9891-6d4b0a8c8fbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:58.712482 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bbb1e7bd-14cb-4fcc-9891-6d4b0a8c8fbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:58.713155 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bbb1e7bd-14cb-4fcc-9891-6d4b0a8c8fbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:58.713605 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bbb1e7bd-14cb-4fcc-9891-6d4b0a8c8fbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:58.714027 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-bbb1e7bd-14cb-4fcc-9891-6d4b0a8c8fbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:58.841900 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-bbb1e7bd-14cb-4fcc-9891-6d4b0a8c8fbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:02:58.850181 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-bbb1e7bd-14cb-4fcc-9891-6d4b0a8c8fbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928" status: 200 len: 1514 microversion: 2.1 time: 0.150754 Oct 03 13:02:58.850751 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 550/1087] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:02:58 2022] GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:02:59.874727 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-94350f22-ba75-47b9-983c-276d66b0dd39 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:02:59.875461 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-94350f22-ba75-47b9-983c-276d66b0dd39 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:02:59.881978 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-94350f22-ba75-47b9-983c-276d66b0dd39 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:59.882463 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-94350f22-ba75-47b9-983c-276d66b0dd39 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:59.882902 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-94350f22-ba75-47b9-983c-276d66b0dd39 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:02:59.883624 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-94350f22-ba75-47b9-983c-276d66b0dd39 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:02:59.884082 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-94350f22-ba75-47b9-983c-276d66b0dd39 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:02:59.884506 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-94350f22-ba75-47b9-983c-276d66b0dd39 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:00.013386 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-94350f22-ba75-47b9-983c-276d66b0dd39 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:03:00.022598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-94350f22-ba75-47b9-983c-276d66b0dd39 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928" status: 200 len: 1514 microversion: 2.1 time: 0.152263 Oct 03 13:03:00.022598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 538/1088] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:02:59 2022] GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:03:00.769078 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-32d3d27b-c791-4a3e-8491-45a02da90f15 req-ca6c25b3-5513-4982-895b-7f3f4cdf7f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac401e60-5900-409b-8939-e86e844d7928", "name": "network-vif-deleted", "tag": "efb683db-15da-417b-b1a9-903689b36df3"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:03:00.778937 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-32d3d27b-c791-4a3e-8491-45a02da90f15 req-ca6c25b3-5513-4982-895b-7f3f4cdf7f11 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:00.781249 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-32d3d27b-c791-4a3e-8491-45a02da90f15 req-ca6c25b3-5513-4982-895b-7f3f4cdf7f11 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:00.781249 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-32d3d27b-c791-4a3e-8491-45a02da90f15 req-ca6c25b3-5513-4982-895b-7f3f4cdf7f11 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:00.791215 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-32d3d27b-c791-4a3e-8491-45a02da90f15 req-ca6c25b3-5513-4982-895b-7f3f4cdf7f11 service nova] Creating event network-vif-deleted:efb683db-15da-417b-b1a9-903689b36df3 for instance ac401e60-5900-409b-8939-e86e844d7928 on hv-cinder-84456 Oct 03 13:03:00.796880 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-32d3d27b-c791-4a3e-8491-45a02da90f15 req-ca6c25b3-5513-4982-895b-7f3f4cdf7f11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032666 Oct 03 13:03:00.797466 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 551/1089] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 13:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:03:01.045939 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-67838983-399d-4797-ae2b-afc47cd5336a tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:01.046646 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-67838983-399d-4797-ae2b-afc47cd5336a tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:01.052933 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67838983-399d-4797-ae2b-afc47cd5336a tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:01.053417 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67838983-399d-4797-ae2b-afc47cd5336a tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:01.053857 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67838983-399d-4797-ae2b-afc47cd5336a tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:01.054548 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67838983-399d-4797-ae2b-afc47cd5336a tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:01.055004 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67838983-399d-4797-ae2b-afc47cd5336a tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:01.055464 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-67838983-399d-4797-ae2b-afc47cd5336a tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:01.119031 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-67838983-399d-4797-ae2b-afc47cd5336a tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:03:01.128100 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-67838983-399d-4797-ae2b-afc47cd5336a tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928" status: 200 len: 1304 microversion: 2.1 time: 0.086528 Oct 03 13:03:01.128680 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 539/1090] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:03:01 2022] GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928 => generated 1304 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:03:02.152094 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7d8187d3-8599-4c07-91cc-4fc8f6e0ae2d tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:02.152747 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-7d8187d3-8599-4c07-91cc-4fc8f6e0ae2d tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: ac401e60-5900-409b-8939-e86e844d7928] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:02.158971 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d8187d3-8599-4c07-91cc-4fc8f6e0ae2d tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:02.159501 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d8187d3-8599-4c07-91cc-4fc8f6e0ae2d tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:02.159948 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d8187d3-8599-4c07-91cc-4fc8f6e0ae2d tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:02.160648 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d8187d3-8599-4c07-91cc-4fc8f6e0ae2d tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:02.161113 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d8187d3-8599-4c07-91cc-4fc8f6e0ae2d tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:02.161553 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-7d8187d3-8599-4c07-91cc-4fc8f6e0ae2d tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:02.174423 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-7d8187d3-8599-4c07-91cc-4fc8f6e0ae2d tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] HTTP exception thrown: Instance ac401e60-5900-409b-8939-e86e844d7928 could not be found. Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7d8187d3-8599-4c07-91cc-4fc8f6e0ae2d tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Request method failure captured: Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928 HTTP/1.1 Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOt1KvF_Ud2GPxfEK1Cxp6L5HgMVNvtkIr8GL4HmTyio700w9uEE4-jZMMDIZJTviLtvHjCy7NRLTRkX83zMK3Q_-ASbW2v20PnXXTgHwZIBLxnYlhWKHsLIrXeVUFf6iGfmxknfimC0zvPRqQjTB_qid1bcqrs784g2w4snC_88zgpo Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 9421d499349f4d90b729021b00961cf2 Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-VolumesSnapshotTestJSON-537398394 Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 13:03:02.176054 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 13:03:02.177796 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9421d499349f4d90b729021b00961cf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9421d499349f4d90b729021b00961cf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9421d499349f4d90b729021b00961cf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9421d499349f4d90b729021b00961cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:03:02.177796 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-VolumesSnapshotTestJSON-537398394 Oct 03 13:03:02.177796 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 9421d499349f4d90b729021b00961cf2 Oct 03 13:03:02.177796 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-537398394 Oct 03 13:03:02.177796 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-VolumesSnapshotTestJSON-537398394-project Oct 03 13:03:02.177796 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 13:03:02.177796 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 13:03:02.177796 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 5a67a58ae60a4e13a3bfe77462c4337e Oct 03 13:03:02.177796 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-VolumesSnapshotTestJSON-537398394-project Oct 03 13:03:02.177796 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 13:03:02.177796 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance ac401e60-5900-409b-8939-e86e844d7928 could not be found. Oct 03 13:03:02.177796 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': 'ac401e60-5900-409b-8939-e86e844d7928'} Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac401e60-5900-409b-8939-e86e844d7928 could not be found. Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:03:02.178789 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac401e60-5900-409b-8939-e86e844d7928 could not be found. Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac401e60-5900-409b-8939-e86e844d7928 could not be found. Oct 03 13:03:02.180489 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:03:02.182149 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-7d8187d3-8599-4c07-91cc-4fc8f6e0ae2d tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Returning 404 to user: Instance ac401e60-5900-409b-8939-e86e844d7928 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:03:02.182149 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-7d8187d3-8599-4c07-91cc-4fc8f6e0ae2d tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928" status: 404 len: 111 microversion: 2.1 time: 0.030196 Oct 03 13:03:02.182149 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 552/1091] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:03:02 2022] GET /compute/v2.1/servers/ac401e60-5900-409b-8939-e86e844d7928 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:03:10.690345 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-82603086", "imageRef": "9d585789-e496-433d-b311-70ec7ceffd99", "flavorRef": "452", "networks": [{"uuid": "739c13ba-8ecd-4b6d-b542-b58a60650305"}]}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:03:10.699598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 13:03:10.699761 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Mon Oct 3 13:03:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Oct 03 13:03:10.751404 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.network.neutron [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] validate_networks() for [('739c13ba-8ecd-4b6d-b542-b58a60650305', None, None, None, None, None)] {{(pid=127544) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:03:11.123385 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:03:11.135840 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Flavor limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:03:11.140197 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Image limits 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:03:11.140197 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Flavor pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:03:11.140197 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Image pref 0:0:0 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:03:11.140197 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.virt.hardware [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:03:11.146869 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:11.147386 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:11.147832 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:11.148566 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:11.149025 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:11.149454 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:11.167032 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Getting quotas for project 9421d499349f4d90b729021b00961cf2. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:03:11.171153 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.quota [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Getting quotas for user 5a67a58ae60a4e13a3bfe77462c4337e and project 9421d499349f4d90b729021b00961cf2. Resources: {'ram', 'cores', 'instances'} {{(pid=127544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:03:11.182230 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Going to run 1 instances... {{(pid=127544) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:03:11.184560 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d585789-e496-433d-b311-70ec7ceffd99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:03:11.330633 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-46bff748-f637-4203-b455-b04061ba3f11 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643985 Oct 03 13:03:11.331285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 540/1092] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 13:03:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 13:03:11.342355 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-4a88928b-d809-4dbe-99d7-b4a28ed55093 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:11.346868 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-4a88928b-d809-4dbe-99d7-b4a28ed55093 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:11.400214 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-4a88928b-d809-4dbe-99d7-b4a28ed55093 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:03:11.407698 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-4a88928b-d809-4dbe-99d7-b4a28ed55093 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687" status: 200 len: 1217 microversion: 2.1 time: 0.068752 Oct 03 13:03:11.408462 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 553/1093] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:03:11 2022] GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:03:12.430418 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-e0b60089-adec-4bb1-b6ea-0ca51e8c7b61 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:12.431028 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-e0b60089-adec-4bb1-b6ea-0ca51e8c7b61 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:12.437023 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e0b60089-adec-4bb1-b6ea-0ca51e8c7b61 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:12.439085 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e0b60089-adec-4bb1-b6ea-0ca51e8c7b61 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:12.439085 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e0b60089-adec-4bb1-b6ea-0ca51e8c7b61 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:12.439310 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e0b60089-adec-4bb1-b6ea-0ca51e8c7b61 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:12.439784 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e0b60089-adec-4bb1-b6ea-0ca51e8c7b61 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:12.440222 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-e0b60089-adec-4bb1-b6ea-0ca51e8c7b61 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:12.500369 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-e0b60089-adec-4bb1-b6ea-0ca51e8c7b61 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:03:12.508591 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-e0b60089-adec-4bb1-b6ea-0ca51e8c7b61 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687" status: 200 len: 1221 microversion: 2.1 time: 0.082329 Oct 03 13:03:12.509148 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 541/1094] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:03:12 2022] GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 => generated 1221 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:03:13.530349 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-fc03cb67-7aa4-4fc6-b814-ebee76d965e4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:13.531092 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-fc03cb67-7aa4-4fc6-b814-ebee76d965e4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:13.534319 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:03:13.539268 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fc03cb67-7aa4-4fc6-b814-ebee76d965e4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:13.541725 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fc03cb67-7aa4-4fc6-b814-ebee76d965e4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:13.541725 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fc03cb67-7aa4-4fc6-b814-ebee76d965e4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:13.541725 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fc03cb67-7aa4-4fc6-b814-ebee76d965e4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:13.541725 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fc03cb67-7aa4-4fc6-b814-ebee76d965e4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:13.542185 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-fc03cb67-7aa4-4fc6-b814-ebee76d965e4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:13.606328 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-fc03cb67-7aa4-4fc6-b814-ebee76d965e4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:03:13.614251 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-fc03cb67-7aa4-4fc6-b814-ebee76d965e4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687" status: 200 len: 1287 microversion: 2.1 time: 0.087887 Oct 03 13:03:13.614830 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 554/1095] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:03:13 2022] GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 => generated 1287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:03:14.638539 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0f719d03-fd99-403f-9410-c21f80ce0f6b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:14.639161 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-0f719d03-fd99-403f-9410-c21f80ce0f6b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:14.646256 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0f719d03-fd99-403f-9410-c21f80ce0f6b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:14.646748 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0f719d03-fd99-403f-9410-c21f80ce0f6b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:14.647189 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0f719d03-fd99-403f-9410-c21f80ce0f6b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:14.647926 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0f719d03-fd99-403f-9410-c21f80ce0f6b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:14.648386 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0f719d03-fd99-403f-9410-c21f80ce0f6b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:14.648817 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0f719d03-fd99-403f-9410-c21f80ce0f6b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:14.778331 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0f719d03-fd99-403f-9410-c21f80ce0f6b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:03:14.786623 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0f719d03-fd99-403f-9410-c21f80ce0f6b tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687" status: 200 len: 1317 microversion: 2.1 time: 0.151946 Oct 03 13:03:14.787200 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 542/1096] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:03:14 2022] GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:03:14.915454 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-1c4c1950-1d27-4f11-bff9-8d0d2869487b req-ad40a7f5-f757-4d8c-a013-dbd29e5e2185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a944337a-f004-48dd-a6f6-2c5b09cba687", "tag": "d91a5a6f-bde8-4686-a88b-d0cb7224cf8e"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:03:14.926974 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-1c4c1950-1d27-4f11-bff9-8d0d2869487b req-ad40a7f5-f757-4d8c-a013-dbd29e5e2185 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:14.927479 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-1c4c1950-1d27-4f11-bff9-8d0d2869487b req-ad40a7f5-f757-4d8c-a013-dbd29e5e2185 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:14.927913 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-1c4c1950-1d27-4f11-bff9-8d0d2869487b req-ad40a7f5-f757-4d8c-a013-dbd29e5e2185 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:14.939491 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-1c4c1950-1d27-4f11-bff9-8d0d2869487b req-ad40a7f5-f757-4d8c-a013-dbd29e5e2185 service nova] Creating event network-changed:d91a5a6f-bde8-4686-a88b-d0cb7224cf8e for instance a944337a-f004-48dd-a6f6-2c5b09cba687 on hv-cinder-84456 Oct 03 13:03:14.945098 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-1c4c1950-1d27-4f11-bff9-8d0d2869487b req-ad40a7f5-f757-4d8c-a013-dbd29e5e2185 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033330 Oct 03 13:03:14.945704 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 555/1097] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 13:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:03:15.810192 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-0706ff84-3b4f-4349-8028-1ba76d80ca4c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:15.810809 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-0706ff84-3b4f-4349-8028-1ba76d80ca4c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:15.817713 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0706ff84-3b4f-4349-8028-1ba76d80ca4c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:15.818200 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0706ff84-3b4f-4349-8028-1ba76d80ca4c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:15.818639 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0706ff84-3b4f-4349-8028-1ba76d80ca4c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:15.819365 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0706ff84-3b4f-4349-8028-1ba76d80ca4c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:15.819808 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0706ff84-3b4f-4349-8028-1ba76d80ca4c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:15.820237 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-0706ff84-3b4f-4349-8028-1ba76d80ca4c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:15.945719 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-0706ff84-3b4f-4349-8028-1ba76d80ca4c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:03:15.953601 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-0706ff84-3b4f-4349-8028-1ba76d80ca4c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687" status: 200 len: 1317 microversion: 2.1 time: 0.147264 Oct 03 13:03:15.954321 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 543/1098] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:03:15 2022] GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:03:16.977840 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-44642f0e-8eae-4334-af77-c0c176f2c324 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:16.978634 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-44642f0e-8eae-4334-af77-c0c176f2c324 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:16.985375 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44642f0e-8eae-4334-af77-c0c176f2c324 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:16.985873 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44642f0e-8eae-4334-af77-c0c176f2c324 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:16.986320 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44642f0e-8eae-4334-af77-c0c176f2c324 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:16.987070 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44642f0e-8eae-4334-af77-c0c176f2c324 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:16.987878 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44642f0e-8eae-4334-af77-c0c176f2c324 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:16.988667 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-44642f0e-8eae-4334-af77-c0c176f2c324 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:17.120534 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-44642f0e-8eae-4334-af77-c0c176f2c324 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:03:17.128971 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-44642f0e-8eae-4334-af77-c0c176f2c324 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687" status: 200 len: 1317 microversion: 2.1 time: 0.155858 Oct 03 13:03:17.129551 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 556/1099] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:03:16 2022] GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:03:18.152475 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-760496bd-9dab-4f3c-a4ff-61719ec9586f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:18.153212 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-760496bd-9dab-4f3c-a4ff-61719ec9586f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:18.159960 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-760496bd-9dab-4f3c-a4ff-61719ec9586f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:18.160391 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-760496bd-9dab-4f3c-a4ff-61719ec9586f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:18.160829 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-760496bd-9dab-4f3c-a4ff-61719ec9586f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:18.161533 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-760496bd-9dab-4f3c-a4ff-61719ec9586f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:18.161990 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-760496bd-9dab-4f3c-a4ff-61719ec9586f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:18.162416 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-760496bd-9dab-4f3c-a4ff-61719ec9586f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:18.289181 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-760496bd-9dab-4f3c-a4ff-61719ec9586f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:03:18.296755 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-760496bd-9dab-4f3c-a4ff-61719ec9586f tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687" status: 200 len: 1317 microversion: 2.1 time: 0.148209 Oct 03 13:03:18.297326 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 544/1100] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:03:18 2022] GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:03:19.319752 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-c666ba60-2e06-4d5b-a166-ff36d79dfdc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:19.320378 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-c666ba60-2e06-4d5b-a166-ff36d79dfdc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:19.327107 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c666ba60-2e06-4d5b-a166-ff36d79dfdc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:19.327787 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c666ba60-2e06-4d5b-a166-ff36d79dfdc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:19.328227 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c666ba60-2e06-4d5b-a166-ff36d79dfdc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:19.328947 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c666ba60-2e06-4d5b-a166-ff36d79dfdc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:19.329403 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c666ba60-2e06-4d5b-a166-ff36d79dfdc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:19.329831 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-c666ba60-2e06-4d5b-a166-ff36d79dfdc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:19.463834 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-c666ba60-2e06-4d5b-a166-ff36d79dfdc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:03:19.471911 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-c666ba60-2e06-4d5b-a166-ff36d79dfdc4 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687" status: 200 len: 1317 microversion: 2.1 time: 0.156014 Oct 03 13:03:19.472475 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 557/1101] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:03:19 2022] GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:03:19.843900 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [req-3c37f5d3-051c-43e5-8681-49ad594da4e2 req-92b80619-396c-4be0-ae1c-6e40826704c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a944337a-f004-48dd-a6f6-2c5b09cba687", "name": "network-vif-plugged", "status": "completed", "tag": "d91a5a6f-bde8-4686-a88b-d0cb7224cf8e"}]} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:03:19.855226 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-3c37f5d3-051c-43e5-8681-49ad594da4e2 req-92b80619-396c-4be0-ae1c-6e40826704c5 service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:19.855681 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-3c37f5d3-051c-43e5-8681-49ad594da4e2 req-92b80619-396c-4be0-ae1c-6e40826704c5 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:19.856122 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [req-3c37f5d3-051c-43e5-8681-49ad594da4e2 req-92b80619-396c-4be0-ae1c-6e40826704c5 service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:19.866914 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.compute.server_external_events [req-3c37f5d3-051c-43e5-8681-49ad594da4e2 req-92b80619-396c-4be0-ae1c-6e40826704c5 service nova] Creating event network-vif-plugged:d91a5a6f-bde8-4686-a88b-d0cb7224cf8e for instance a944337a-f004-48dd-a6f6-2c5b09cba687 on hv-cinder-84456 Oct 03 13:03:19.872196 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [req-3c37f5d3-051c-43e5-8681-49ad594da4e2 req-92b80619-396c-4be0-ae1c-6e40826704c5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032103 Oct 03 13:03:19.876194 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 545/1102] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 13:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:03:20.495408 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-058ea9e2-f917-4034-8e32-f8635d7ddbd3 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:20.495945 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-058ea9e2-f917-4034-8e32-f8635d7ddbd3 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:20.502877 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-058ea9e2-f917-4034-8e32-f8635d7ddbd3 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:20.503390 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-058ea9e2-f917-4034-8e32-f8635d7ddbd3 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:20.503831 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-058ea9e2-f917-4034-8e32-f8635d7ddbd3 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:20.504528 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-058ea9e2-f917-4034-8e32-f8635d7ddbd3 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:20.504988 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-058ea9e2-f917-4034-8e32-f8635d7ddbd3 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:20.505417 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-058ea9e2-f917-4034-8e32-f8635d7ddbd3 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:20.632736 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-058ea9e2-f917-4034-8e32-f8635d7ddbd3 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:03:20.640404 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-058ea9e2-f917-4034-8e32-f8635d7ddbd3 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687" status: 200 len: 1317 microversion: 2.1 time: 0.148954 Oct 03 13:03:20.640976 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 558/1103] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:03:20 2022] GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:03:21.662307 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=2 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:03:21.662980 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell0:SELECT=6 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:03:21.666946 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-d1035367-05b1-4603-9472-197c1d3fab5c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:21.667670 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-d1035367-05b1-4603-9472-197c1d3fab5c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:21.674285 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d1035367-05b1-4603-9472-197c1d3fab5c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:21.674801 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d1035367-05b1-4603-9472-197c1d3fab5c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:21.675196 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d1035367-05b1-4603-9472-197c1d3fab5c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:21.675897 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d1035367-05b1-4603-9472-197c1d3fab5c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:21.676351 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d1035367-05b1-4603-9472-197c1d3fab5c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:21.676771 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-d1035367-05b1-4603-9472-197c1d3fab5c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:21.806853 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-d1035367-05b1-4603-9472-197c1d3fab5c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:03:21.814508 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-d1035367-05b1-4603-9472-197c1d3fab5c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687" status: 200 len: 1317 microversion: 2.1 time: 0.153668 Oct 03 13:03:21.815084 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 546/1104] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:03:21 2022] GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:03:22.837707 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-5d3c0b09-75b7-4b05-bce9-01b47d1affbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:22.838325 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-5d3c0b09-75b7-4b05-bce9-01b47d1affbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:22.840362 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell0:SELECT=2 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:03:22.845715 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5d3c0b09-75b7-4b05-bce9-01b47d1affbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:22.846203 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5d3c0b09-75b7-4b05-bce9-01b47d1affbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:22.846641 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5d3c0b09-75b7-4b05-bce9-01b47d1affbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:22.847343 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5d3c0b09-75b7-4b05-bce9-01b47d1affbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:22.847810 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5d3c0b09-75b7-4b05-bce9-01b47d1affbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:22.848238 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-5d3c0b09-75b7-4b05-bce9-01b47d1affbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:22.979612 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-5d3c0b09-75b7-4b05-bce9-01b47d1affbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:03:22.988429 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-5d3c0b09-75b7-4b05-bce9-01b47d1affbe tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687" status: 200 len: 1507 microversion: 2.1 time: 0.154570 Oct 03 13:03:22.989153 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 559/1105] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:03:22 2022] GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:03:23.018387 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-6e20f4e1-e217-4a20-9698-1bbc43e57fec tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bfe47c1-c45b-44d4-a8f6-58a342f903fb", "device": "/dev/sdb"}} {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:03:23.020905 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-6e20f4e1-e217-4a20-9698-1bbc43e57fec tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:23.027419 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6e20f4e1-e217-4a20-9698-1bbc43e57fec tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:23.027902 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6e20f4e1-e217-4a20-9698-1bbc43e57fec tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:23.028337 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6e20f4e1-e217-4a20-9698-1bbc43e57fec tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:23.029037 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6e20f4e1-e217-4a20-9698-1bbc43e57fec tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:23.029491 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6e20f4e1-e217-4a20-9698-1bbc43e57fec tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:23.029909 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-6e20f4e1-e217-4a20-9698-1bbc43e57fec tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:23.681588 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-6e20f4e1-e217-4a20-9698-1bbc43e57fec tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "POST /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.666823 Oct 03 13:03:23.682117 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 547/1106] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 13:03:23 2022] POST /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687/os-volume_attachments => generated 194 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:03:43.658653 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-b95c546d-7a3d-4931-ad9c-b8bb7311bfac tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:43.659169 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-b95c546d-7a3d-4931-ad9c-b8bb7311bfac tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:43.661126 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_api:SELECT=24 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:03:43.661907 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG dbcounter [-] [127542] Writing DB stats nova_cell1:SELECT=32 {{(pid=127542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:03:43.666448 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b95c546d-7a3d-4931-ad9c-b8bb7311bfac tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:43.670453 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b95c546d-7a3d-4931-ad9c-b8bb7311bfac tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:43.670453 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b95c546d-7a3d-4931-ad9c-b8bb7311bfac tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:43.670453 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b95c546d-7a3d-4931-ad9c-b8bb7311bfac tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:43.670453 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b95c546d-7a3d-4931-ad9c-b8bb7311bfac tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:43.670803 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-b95c546d-7a3d-4931-ad9c-b8bb7311bfac tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:43.748537 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.objects.instance [None req-b95c546d-7a3d-4931-ad9c-b8bb7311bfac tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lazy-loading 'services' on Instance uuid a944337a-f004-48dd-a6f6-2c5b09cba687 {{(pid=127542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:03:43.944559 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-b95c546d-7a3d-4931-ad9c-b8bb7311bfac tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687/os-volume_attachments/8bfe47c1-c45b-44d4-a8f6-58a342f903fb" status: 202 len: 0 microversion: 2.1 time: 0.290420 Oct 03 13:03:43.945093 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 560/1107] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 13:03:43 2022] DELETE /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687/os-volume_attachments/8bfe47c1-c45b-44d4-a8f6-58a342f903fb => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:03:45.070013 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-f065b863-7095-47c2-8fa3-f4c903e0e309 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:45.070598 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-f065b863-7095-47c2-8fa3-f4c903e0e309 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:45.073161 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:03:45.073818 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG dbcounter [-] [127544] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:03:45.078650 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f065b863-7095-47c2-8fa3-f4c903e0e309 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:45.084210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f065b863-7095-47c2-8fa3-f4c903e0e309 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:45.084210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f065b863-7095-47c2-8fa3-f4c903e0e309 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:45.084210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f065b863-7095-47c2-8fa3-f4c903e0e309 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:45.084210 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f065b863-7095-47c2-8fa3-f4c903e0e309 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:45.084617 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-f065b863-7095-47c2-8fa3-f4c903e0e309 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:45.107339 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-f065b863-7095-47c2-8fa3-f4c903e0e309 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Going to try to terminate instance {{(pid=127544) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:03:45.262307 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 13:03:45.262486 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: Mon Oct 3 13:03:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 (ip 10.222.0.33) !!! Oct 03 13:03:45.409193 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-f065b863-7095-47c2-8fa3-f4c903e0e309 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687" status: 204 len: 0 microversion: 2.1 time: 0.341973 Oct 03 13:03:45.409788 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 548/1108] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 13:03:45 2022] DELETE /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:03:45.419829 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-3cafd1f6-a9ef-49f9-b9d1-0cb8fc0b10dd tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:45.422438 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-3cafd1f6-a9ef-49f9-b9d1-0cb8fc0b10dd tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:45.427625 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3cafd1f6-a9ef-49f9-b9d1-0cb8fc0b10dd tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:45.428113 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3cafd1f6-a9ef-49f9-b9d1-0cb8fc0b10dd tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:45.428555 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3cafd1f6-a9ef-49f9-b9d1-0cb8fc0b10dd tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:45.429260 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3cafd1f6-a9ef-49f9-b9d1-0cb8fc0b10dd tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:45.429719 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3cafd1f6-a9ef-49f9-b9d1-0cb8fc0b10dd tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:45.430155 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-3cafd1f6-a9ef-49f9-b9d1-0cb8fc0b10dd tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:45.557317 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.policy [None req-3cafd1f6-a9ef-49f9-b9d1-0cb8fc0b10dd tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:03:45.565659 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-3cafd1f6-a9ef-49f9-b9d1-0cb8fc0b10dd tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687" status: 200 len: 1513 microversion: 2.1 time: 0.151510 Oct 03 13:03:45.566221 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 561/1109] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:03:45 2022] GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:03:46.590388 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-7881cd02-a0bc-4445-973a-56ea9c1e3e0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:46.591015 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-7881cd02-a0bc-4445-973a-56ea9c1e3e0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:46.598207 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7881cd02-a0bc-4445-973a-56ea9c1e3e0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:46.598691 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7881cd02-a0bc-4445-973a-56ea9c1e3e0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:46.599131 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7881cd02-a0bc-4445-973a-56ea9c1e3e0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:46.599851 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7881cd02-a0bc-4445-973a-56ea9c1e3e0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:46.600308 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7881cd02-a0bc-4445-973a-56ea9c1e3e0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:46.600734 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-7881cd02-a0bc-4445-973a-56ea9c1e3e0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:46.730160 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-7881cd02-a0bc-4445-973a-56ea9c1e3e0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:03:46.737804 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-7881cd02-a0bc-4445-973a-56ea9c1e3e0c tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687" status: 200 len: 1513 microversion: 2.1 time: 0.151753 Oct 03 13:03:46.738367 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 549/1110] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:03:46 2022] GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:03:47.759816 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [req-fec7b1d2-1c22-4d4f-9c08-b1920ba8a4ff req-09e3a9ad-089a-4c94-b2fb-58c5b91f257a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a944337a-f004-48dd-a6f6-2c5b09cba687", "name": "network-vif-deleted", "tag": "d91a5a6f-bde8-4686-a88b-d0cb7224cf8e"}]} {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:03:47.760374 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.api.openstack.wsgi [None req-677d5aa1-1598-43c2-a7a0-405027a77eea tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:47.760864 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.compute.api [None req-677d5aa1-1598-43c2-a7a0-405027a77eea tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127544) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:47.768315 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-677d5aa1-1598-43c2-a7a0-405027a77eea tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:47.769075 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-677d5aa1-1598-43c2-a7a0-405027a77eea tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:47.769526 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-677d5aa1-1598-43c2-a7a0-405027a77eea tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:47.769669 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-fec7b1d2-1c22-4d4f-9c08-b1920ba8a4ff req-09e3a9ad-089a-4c94-b2fb-58c5b91f257a service nova] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:47.770046 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-fec7b1d2-1c22-4d4f-9c08-b1920ba8a4ff req-09e3a9ad-089a-4c94-b2fb-58c5b91f257a service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:47.770239 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-677d5aa1-1598-43c2-a7a0-405027a77eea tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:47.770864 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-677d5aa1-1598-43c2-a7a0-405027a77eea tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:47.770984 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [req-fec7b1d2-1c22-4d4f-9c08-b1920ba8a4ff req-09e3a9ad-089a-4c94-b2fb-58c5b91f257a service nova] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:47.771276 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG oslo_concurrency.lockutils [None req-677d5aa1-1598-43c2-a7a0-405027a77eea tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:47.782833 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.compute.server_external_events [req-fec7b1d2-1c22-4d4f-9c08-b1920ba8a4ff req-09e3a9ad-089a-4c94-b2fb-58c5b91f257a service nova] Creating event network-vif-deleted:d91a5a6f-bde8-4686-a88b-d0cb7224cf8e for instance a944337a-f004-48dd-a6f6-2c5b09cba687 on hv-cinder-84456 Oct 03 13:03:47.788062 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [req-fec7b1d2-1c22-4d4f-9c08-b1920ba8a4ff req-09e3a9ad-089a-4c94-b2fb-58c5b91f257a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031817 Oct 03 13:03:47.788701 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 562/1111] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 13:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:03:47.838023 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: DEBUG nova.policy [None req-677d5aa1-1598-43c2-a7a0-405027a77eea tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a67a58ae60a4e13a3bfe77462c4337e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9421d499349f4d90b729021b00961cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127544) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:03:47.845982 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: INFO nova.api.openstack.requestlog [None req-677d5aa1-1598-43c2-a7a0-405027a77eea tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687" status: 200 len: 1471 microversion: 2.1 time: 0.089691 Oct 03 13:03:47.846551 dv-cinder-844563-12-iscsi devstack@n-api.service[127544]: [pid: 127544|app: 0|req: 550/1112] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:03:47 2022] GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 => generated 1471 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:03:48.870020 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f0eb67ca-475c-4aa5-9485-0248547965f2 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Calling method '>' {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:03:48.870730 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.compute.api [None req-f0eb67ca-475c-4aa5-9485-0248547965f2 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] [instance: a944337a-f004-48dd-a6f6-2c5b09cba687] Fetching instance by UUID {{(pid=127542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:03:48.882119 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f0eb67ca-475c-4aa5-9485-0248547965f2 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:48.882119 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f0eb67ca-475c-4aa5-9485-0248547965f2 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:48.882119 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f0eb67ca-475c-4aa5-9485-0248547965f2 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:48.882119 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f0eb67ca-475c-4aa5-9485-0248547965f2 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Acquiring lock "57c6aefa-012f-4d1a-b081-6750fab41575" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:03:48.882548 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f0eb67ca-475c-4aa5-9485-0248547965f2 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:03:48.882548 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG oslo_concurrency.lockutils [None req-f0eb67ca-475c-4aa5-9485-0248547965f2 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Lock "57c6aefa-012f-4d1a-b081-6750fab41575" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:03:48.899060 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.wsgi [None req-f0eb67ca-475c-4aa5-9485-0248547965f2 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] HTTP exception thrown: Instance a944337a-f004-48dd-a6f6-2c5b09cba687 could not be found. Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f0eb67ca-475c-4aa5-9485-0248547965f2 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Request method failure captured: Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: request: GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 HTTP/1.1 Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept: application/json Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Accept-Encoding: identity Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Connection: close Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Length: 0 Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Content-Type: application/json Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Host: 10.222.0.33 Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: Openstack-System-Scope: None Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: User-Agent: python-urllib3/1.26.12 Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Auth-Token: gAAAAABjOt1KvF_Ud2GPxfEK1Cxp6L5HgMVNvtkIr8GL4HmTyio700w9uEE4-jZMMDIZJTviLtvHjCy7NRLTRkX83zMK3Q_-ASbW2v20PnXXTgHwZIBLxnYlhWKHsLIrXeVUFf6iGfmxknfimC0zvPRqQjTB_qid1bcqrs784g2w4snC_88zgpo Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Id: None Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Domain-Name: None Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Identity-Status: Confirmed Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Is-Admin-Project: True Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Id: default Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Domain-Name: Default Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Id: 9421d499349f4d90b729021b00961cf2 Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Project-Name: tempest-VolumesSnapshotTestJSON-537398394 Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Role: member,reader Oct 03 13:03:48.900958 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Roles: member,reader Oct 03 13:03:48.904275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9421d499349f4d90b729021b00961cf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9421d499349f4d90b729021b00961cf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9421d499349f4d90b729021b00961cf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9421d499349f4d90b729021b00961cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 13:03:48.904275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant: tempest-VolumesSnapshotTestJSON-537398394 Oct 03 13:03:48.904275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Id: 9421d499349f4d90b729021b00961cf2 Oct 03 13:03:48.904275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-537398394 Oct 03 13:03:48.904275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User: tempest-VolumesSnapshotTestJSON-537398394-project Oct 03 13:03:48.904275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Id: default Oct 03 13:03:48.904275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Domain-Name: Default Oct 03 13:03:48.904275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Id: 5a67a58ae60a4e13a3bfe77462c4337e Oct 03 13:03:48.904275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: X-User-Name: tempest-VolumesSnapshotTestJSON-537398394-project Oct 03 13:03:48.904275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: method: > Oct 03 13:03:48.904275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: exception: Instance a944337a-f004-48dd-a6f6-2c5b09cba687 could not be found. Oct 03 13:03:48.904275 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: action_args: {'id': 'a944337a-f004-48dd-a6f6-2c5b09cba687'} Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: {{(pid=127542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a944337a-f004-48dd-a6f6-2c5b09cba687 could not be found. Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:03:48.906459 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a944337a-f004-48dd-a6f6-2c5b09cba687 could not be found. Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a944337a-f004-48dd-a6f6-2c5b09cba687 could not be found. Oct 03 13:03:48.910220 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: ERROR nova.api.openstack.wsgi Oct 03 13:03:48.913852 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: DEBUG nova.api.openstack.wsgi [None req-f0eb67ca-475c-4aa5-9485-0248547965f2 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] Returning 404 to user: Instance a944337a-f004-48dd-a6f6-2c5b09cba687 could not be found. {{(pid=127542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:03:48.913852 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: INFO nova.api.openstack.requestlog [None req-f0eb67ca-475c-4aa5-9485-0248547965f2 tempest-VolumesSnapshotTestJSON-537398394 tempest-VolumesSnapshotTestJSON-537398394-project] 10.222.0.33 "GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687" status: 404 len: 111 microversion: 2.1 time: 0.037895 Oct 03 13:03:48.913852 dv-cinder-844563-12-iscsi devstack@n-api.service[127542]: [pid: 127542|app: 0|req: 563/1113] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 13:03:48 2022] GET /compute/v2.1/servers/a944337a-f004-48dd-a6f6-2c5b09cba687 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)